Note: This is test shard 8 of 8.
[==========] Running 7 tests from 6 test suites.
[----------] Global test environment set-up.
[----------] 1 test from TableRangeRebalancingTest
[ RUN ] TableRangeRebalancingTest.Basic
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 20:45:25.906311 9546 test_util.cc:268] Using random seed: -1362643087
I20240502 20:45:25.913419 9546 ts_itest-base.cc:112] Starting cluster with:
I20240502 20:45:25.913543 9546 ts_itest-base.cc:113] --------------
I20240502 20:45:25.913590 9546 ts_itest-base.cc:114] 3 tablet servers
I20240502 20:45:25.913622 9546 ts_itest-base.cc:115] 3 replicas per TS
I20240502 20:45:25.913642 9546 ts_itest-base.cc:116] --------------
2024-05-02T20:45:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T20:45:25Z Disabled control of system clock
I20240502 20:45:25.924698 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:40117
--webserver_interface=127.9.82.190
--webserver_port=0
--builtin_ntp_servers=127.9.82.148:38143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.82.190:40117
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false with env {}
W20240502 20:45:26.038589 9558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:26.038867 9558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:26.038909 9558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:26.042138 9558 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:26.042222 9558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 20:45:26.042248 9558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:26.042265 9558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 20:45:26.042282 9558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 20:45:26.046134 9558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.9.82.190:40117
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:40117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.9.82.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.9558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:26.047108 9558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:26.048328 9558 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:26.056521 9566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:26.056959 9563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:26.057616 9558 server_base.cc:1034] running on GCE node
W20240502 20:45:26.058030 9564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:26.058609 9558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:26.059608 9558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:26.060779 9558 hybrid_clock.cc:648] HybridClock initialized: now 1714682726060773 us; error 40 us; skew 500 ppm
I20240502 20:45:26.072970 9558 webserver.cc:460] Webserver started at http://127.9.82.190:38911/ using document root <none> and password file <none>
I20240502 20:45:26.073587 9558 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:26.073644 9558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:26.073822 9558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:26.075588 9558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "4c331c21268b4fa5a1d5fa6543395113"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.076138 9558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "4c331c21268b4fa5a1d5fa6543395113"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.079602 9558 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:45:26.082132 9572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.083223 9558 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:26.083369 9558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
uuid: "4c331c21268b4fa5a1d5fa6543395113"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.083467 9558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:26.102062 9558 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:26.102816 9558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:26.103008 9558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:26.110399 9558 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.190:40117
I20240502 20:45:26.110421 9624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.190:40117 every 8 connection(s)
I20240502 20:45:26.111510 9558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 20:45:26.114454 9625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:26.119869 9625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113: Bootstrap starting.
I20240502 20:45:26.121585 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 9558
I20240502 20:45:26.121721 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 20:45:26.122399 9625 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:26.123128 9625 log.cc:824] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:26.125280 9625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113: No bootstrap required, opened a new log
I20240502 20:45:26.128566 9625 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c331c21268b4fa5a1d5fa6543395113" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40117 } }
I20240502 20:45:26.128844 9625 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:26.128906 9625 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c331c21268b4fa5a1d5fa6543395113, State: Initialized, Role: FOLLOWER
I20240502 20:45:26.129511 9625 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c331c21268b4fa5a1d5fa6543395113" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40117 } }
I20240502 20:45:26.129734 9625 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:45:26.129866 9625 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:45:26.130004 9625 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:26.131055 9625 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c331c21268b4fa5a1d5fa6543395113" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40117 } }
I20240502 20:45:26.131443 9625 leader_election.cc:302] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c331c21268b4fa5a1d5fa6543395113; no voters:
I20240502 20:45:26.131860 9625 leader_election.cc:288] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:45:26.132272 9630 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:26.132551 9630 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [term 1 LEADER]: Becoming Leader. State: Replica: 4c331c21268b4fa5a1d5fa6543395113, State: Running, Role: LEADER
I20240502 20:45:26.132936 9630 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c331c21268b4fa5a1d5fa6543395113" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40117 } }
I20240502 20:45:26.133105 9625 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 20:45:26.134842 9632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c331c21268b4fa5a1d5fa6543395113. Latest consensus state: current_term: 1 leader_uuid: "4c331c21268b4fa5a1d5fa6543395113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c331c21268b4fa5a1d5fa6543395113" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40117 } } }
I20240502 20:45:26.135004 9632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [sys.catalog]: This master's current role is: LEADER
I20240502 20:45:26.135389 9631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c331c21268b4fa5a1d5fa6543395113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c331c21268b4fa5a1d5fa6543395113" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40117 } } }
I20240502 20:45:26.135497 9631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113 [sys.catalog]: This master's current role is: LEADER
I20240502 20:45:26.135867 9641 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 20:45:26.140198 9641 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 20:45:26.146528 9641 catalog_manager.cc:1347] Generated new cluster ID: 367c930079c34746a5587a1775f3a894
I20240502 20:45:26.146624 9641 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 20:45:26.152529 9641 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 20:45:26.153594 9641 catalog_manager.cc:1504] Loading token signing keys...
I20240502 20:45:26.169248 9641 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 4c331c21268b4fa5a1d5fa6543395113: Generated new TSK 0
I20240502 20:45:26.170248 9641 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 20:45:26.179595 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.129:0
--local_ip_for_outbound_sockets=127.9.82.129
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40117
--builtin_ntp_servers=127.9.82.148:38143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:45:26.293936 9649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:26.294189 9649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:26.294235 9649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:26.297573 9649 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:26.297658 9649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:26.297740 9649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.129
I20240502 20:45:26.301694 9649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40117
--never_fsync=true
--heap_profile_path=/tmp/kudu.9649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.129
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:26.302719 9649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:26.303992 9649 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:26.313059 9657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:26.313594 9654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:26.314145 9655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:26.314850 9649 server_base.cc:1034] running on GCE node
I20240502 20:45:26.315299 9649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:26.315982 9649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:26.317153 9649 hybrid_clock.cc:648] HybridClock initialized: now 1714682726317130 us; error 37 us; skew 500 ppm
I20240502 20:45:26.319205 9649 webserver.cc:460] Webserver started at http://127.9.82.129:46413/ using document root <none> and password file <none>
I20240502 20:45:26.319845 9649 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:26.319916 9649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:26.320111 9649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:26.321861 9649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.322384 9649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.326021 9649 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 20:45:26.328490 9663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.329660 9649 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:45:26.329820 9649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.329927 9649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:26.352949 9649 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:26.353701 9649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:26.353891 9649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:26.354497 9649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:26.355615 9649 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:26.355665 9649 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.355705 9649 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:26.355762 9649 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.364723 9649 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.129:35171
I20240502 20:45:26.364754 9776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.129:35171 every 8 connection(s)
I20240502 20:45:26.365729 9649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 20:45:26.366560 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 9649
I20240502 20:45:26.366664 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 20:45:26.369083 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.130:0
--local_ip_for_outbound_sockets=127.9.82.130
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40117
--builtin_ntp_servers=127.9.82.148:38143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:26.376294 9777 heartbeater.cc:347] Connected to a master server at 127.9.82.190:40117
I20240502 20:45:26.376546 9777 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:26.377133 9777 heartbeater.cc:511] Master 127.9.82.190:40117 requested a full tablet report, sending...
I20240502 20:45:26.378583 9589 ts_manager.cc:194] Registered new tserver with Master: 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171)
I20240502 20:45:26.379854 9589 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.129:60541
W20240502 20:45:26.481802 9780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:26.482060 9780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:26.482105 9780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:26.485332 9780 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:26.485411 9780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:26.485487 9780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.130
I20240502 20:45:26.489370 9780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40117
--never_fsync=true
--heap_profile_path=/tmp/kudu.9780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.130
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:26.490346 9780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:26.491508 9780 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:26.500203 9788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:26.500619 9785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:26.501178 9786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:26.501824 9780 server_base.cc:1034] running on GCE node
I20240502 20:45:26.502280 9780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:26.502933 9780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:26.504093 9780 hybrid_clock.cc:648] HybridClock initialized: now 1714682726504067 us; error 42 us; skew 500 ppm
I20240502 20:45:26.506201 9780 webserver.cc:460] Webserver started at http://127.9.82.130:44537/ using document root <none> and password file <none>
I20240502 20:45:26.506780 9780 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:26.506850 9780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:26.507035 9780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:26.508844 9780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "807a93eca2cf4b17906c4c6febcdea84"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.509352 9780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "807a93eca2cf4b17906c4c6febcdea84"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.513118 9780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240502 20:45:26.515664 9794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.516829 9780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:45:26.516940 9780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "807a93eca2cf4b17906c4c6febcdea84"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.517050 9780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:26.531678 9780 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:26.532528 9780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:26.532719 9780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:26.533535 9780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:26.534883 9780 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:26.534946 9780 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.535014 9780 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:26.535048 9780 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.544414 9780 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.130:45951
I20240502 20:45:26.544435 9907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.130:45951 every 8 connection(s)
I20240502 20:45:26.545410 9780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 20:45:26.546106 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 9780
I20240502 20:45:26.546209 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 20:45:26.548627 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.131:0
--local_ip_for_outbound_sockets=127.9.82.131
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40117
--builtin_ntp_servers=127.9.82.148:38143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:26.554881 9908 heartbeater.cc:347] Connected to a master server at 127.9.82.190:40117
I20240502 20:45:26.555205 9908 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:26.555850 9908 heartbeater.cc:511] Master 127.9.82.190:40117 requested a full tablet report, sending...
I20240502 20:45:26.556968 9589 ts_manager.cc:194] Registered new tserver with Master: 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951)
I20240502 20:45:26.557847 9589 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.130:43315
W20240502 20:45:26.664088 9911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:26.664338 9911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:26.664387 9911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:26.667519 9911 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:26.667593 9911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:26.667671 9911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.131
I20240502 20:45:26.671643 9911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40117
--never_fsync=true
--heap_profile_path=/tmp/kudu.9911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.131
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:26.672685 9911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:26.673871 9911 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:26.682876 9917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:26.683303 9919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:26.683948 9916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:26.684607 9911 server_base.cc:1034] running on GCE node
I20240502 20:45:26.685082 9911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:26.685724 9911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:26.686918 9911 hybrid_clock.cc:648] HybridClock initialized: now 1714682726686889 us; error 44 us; skew 500 ppm
I20240502 20:45:26.689184 9911 webserver.cc:460] Webserver started at http://127.9.82.131:33743/ using document root <none> and password file <none>
I20240502 20:45:26.689775 9911 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:26.689843 9911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:26.690053 9911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:26.691890 9911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "3d6a8733c1744c1b86231135574cd4f3"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.692386 9911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "3d6a8733c1744c1b86231135574cd4f3"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.696285 9911 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20240502 20:45:26.699594 9925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.700800 9911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:26.700935 9911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "3d6a8733c1744c1b86231135574cd4f3"
format_stamp: "Formatted at 2024-05-02 20:45:26 on dist-test-slave-2pss"
I20240502 20:45:26.701037 9911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:26.732558 9911 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:26.733312 9911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:26.733528 9911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:26.734162 9911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:26.735148 9911 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:26.735204 9911 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.735275 9911 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:26.735301 9911 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:26.744091 9911 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.131:34815
I20240502 20:45:26.744122 10038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.131:34815 every 8 connection(s)
I20240502 20:45:26.745082 9911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 20:45:26.746152 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 9911
I20240502 20:45:26.746260 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 20:45:26.754282 10039 heartbeater.cc:347] Connected to a master server at 127.9.82.190:40117
I20240502 20:45:26.754527 10039 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:26.755059 10039 heartbeater.cc:511] Master 127.9.82.190:40117 requested a full tablet report, sending...
I20240502 20:45:26.756141 9589 ts_manager.cc:194] Registered new tserver with Master: 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:26.756712 9589 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.131:44511
I20240502 20:45:26.760865 9546 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20240502 20:45:26.772619 9546 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20240502 20:45:27.382161 9777 heartbeater.cc:503] Master 127.9.82.190:40117 was elected leader, sending a full tablet report...
I20240502 20:45:27.560007 9908 heartbeater.cc:503] Master 127.9.82.190:40117 was elected leader, sending a full tablet report...
I20240502 20:45:27.758772 10039 heartbeater.cc:503] Master 127.9.82.190:40117 was elected leader, sending a full tablet report...
I20240502 20:45:30.525651 9589 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36604:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\200\007\001\000\000\000\000\000\006\001\000\000\000\000\000\007\001\000\377\377\377\177"
indirect_data: "<redacted>"""
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 8
seed: 0
}
}
W20240502 20:45:30.530303 9589 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 20:45:30.557451 9973 tablet_service.cc:1467] Processing CreateTablet for tablet 037c78e49d4a476d99e41830b69f6909 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.558214 9970 tablet_service.cc:1467] Processing CreateTablet for tablet 6c57b12ce15d4e958c6486ebec50d90f (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.558708 9969 tablet_service.cc:1467] Processing CreateTablet for tablet d8f6444b9ad741e786a07b7c5e0ebabc (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.559088 9968 tablet_service.cc:1467] Processing CreateTablet for tablet 7505a36f7f6240beba4174043f5c4e39 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.559422 9967 tablet_service.cc:1467] Processing CreateTablet for tablet 3744180ae7fe4cbc96a28c2d48aaea36 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.559824 9966 tablet_service.cc:1467] Processing CreateTablet for tablet 50c4744713b74e5b921891bbb9e9f51d (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.559316 9831 tablet_service.cc:1467] Processing CreateTablet for tablet a190505d090d48449d98105ee3cf265f (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.560070 9830 tablet_service.cc:1467] Processing CreateTablet for tablet e7ab4b4ef882419189c7573251047f12 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.560169 9965 tablet_service.cc:1467] Processing CreateTablet for tablet 992494c112194a06b01ebe322edc4bbf (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.560564 9964 tablet_service.cc:1467] Processing CreateTablet for tablet 4cf4710ff63a4b2e941051de4ddc87e3 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.560636 9831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a190505d090d48449d98105ee3cf265f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.560997 9830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7ab4b4ef882419189c7573251047f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.560936 9963 tablet_service.cc:1467] Processing CreateTablet for tablet 01dcdd9559db4734ab95f1ec241c58a2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.561277 9962 tablet_service.cc:1467] Processing CreateTablet for tablet a190505d090d48449d98105ee3cf265f (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.561650 9842 tablet_service.cc:1467] Processing CreateTablet for tablet 037c78e49d4a476d99e41830b69f6909 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.561936 9842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 037c78e49d4a476d99e41830b69f6909. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.562496 9961 tablet_service.cc:1467] Processing CreateTablet for tablet e7ab4b4ef882419189c7573251047f12 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.562870 9960 tablet_service.cc:1467] Processing CreateTablet for tablet 241fc777dd3b42aaadaa191e58104004 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.563271 9841 tablet_service.cc:1467] Processing CreateTablet for tablet bfc3de218c34422f95da14f9b33bd822 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.563588 9841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfc3de218c34422f95da14f9b33bd822. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.564749 9959 tablet_service.cc:1467] Processing CreateTablet for tablet 4ba36f9bccbd4ca6968e9d2376439673 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.565114 9840 tablet_service.cc:1467] Processing CreateTablet for tablet 88cb5e5e85034b19a5b83da5144de6be (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.565368 9840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88cb5e5e85034b19a5b83da5144de6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.565084 9705 tablet_service.cc:1467] Processing CreateTablet for tablet 3744180ae7fe4cbc96a28c2d48aaea36 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.566547 9708 tablet_service.cc:1467] Processing CreateTablet for tablet 6c57b12ce15d4e958c6486ebec50d90f (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.566783 9839 tablet_service.cc:1467] Processing CreateTablet for tablet 6c57b12ce15d4e958c6486ebec50d90f (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.567067 9839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c57b12ce15d4e958c6486ebec50d90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.567196 9708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c57b12ce15d4e958c6486ebec50d90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.567610 9705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3744180ae7fe4cbc96a28c2d48aaea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.569777 9838 tablet_service.cc:1467] Processing CreateTablet for tablet d8f6444b9ad741e786a07b7c5e0ebabc (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.570091 9838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f6444b9ad741e786a07b7c5e0ebabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.571614 9697 tablet_service.cc:1467] Processing CreateTablet for tablet 4ba36f9bccbd4ca6968e9d2376439673 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.571929 9697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ba36f9bccbd4ca6968e9d2376439673. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.572144 9706 tablet_service.cc:1467] Processing CreateTablet for tablet 7505a36f7f6240beba4174043f5c4e39 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.572343 9837 tablet_service.cc:1467] Processing CreateTablet for tablet 7505a36f7f6240beba4174043f5c4e39 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.572438 9706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7505a36f7f6240beba4174043f5c4e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.572593 9837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7505a36f7f6240beba4174043f5c4e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.574801 9829 tablet_service.cc:1467] Processing CreateTablet for tablet 241fc777dd3b42aaadaa191e58104004 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.575095 9829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 241fc777dd3b42aaadaa191e58104004. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.575250 9704 tablet_service.cc:1467] Processing CreateTablet for tablet 50c4744713b74e5b921891bbb9e9f51d (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.575531 9704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50c4744713b74e5b921891bbb9e9f51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.576063 9836 tablet_service.cc:1467] Processing CreateTablet for tablet 3744180ae7fe4cbc96a28c2d48aaea36 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.576107 9698 tablet_service.cc:1467] Processing CreateTablet for tablet 241fc777dd3b42aaadaa191e58104004 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.576344 9836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3744180ae7fe4cbc96a28c2d48aaea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.576392 9698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 241fc777dd3b42aaadaa191e58104004. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.577531 9703 tablet_service.cc:1467] Processing CreateTablet for tablet 992494c112194a06b01ebe322edc4bbf (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.577802 9703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 992494c112194a06b01ebe322edc4bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.578739 9835 tablet_service.cc:1467] Processing CreateTablet for tablet 50c4744713b74e5b921891bbb9e9f51d (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.579056 9835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50c4744713b74e5b921891bbb9e9f51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.579988 9702 tablet_service.cc:1467] Processing CreateTablet for tablet 4cf4710ff63a4b2e941051de4ddc87e3 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.580268 9702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cf4710ff63a4b2e941051de4ddc87e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.581261 9834 tablet_service.cc:1467] Processing CreateTablet for tablet 992494c112194a06b01ebe322edc4bbf (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.581528 9834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 992494c112194a06b01ebe322edc4bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.582057 9701 tablet_service.cc:1467] Processing CreateTablet for tablet 01dcdd9559db4734ab95f1ec241c58a2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.582317 9701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dcdd9559db4734ab95f1ec241c58a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.583447 9833 tablet_service.cc:1467] Processing CreateTablet for tablet 4cf4710ff63a4b2e941051de4ddc87e3 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.583753 9833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cf4710ff63a4b2e941051de4ddc87e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.584085 9699 tablet_service.cc:1467] Processing CreateTablet for tablet e7ab4b4ef882419189c7573251047f12 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.566265 9709 tablet_service.cc:1467] Processing CreateTablet for tablet 88cb5e5e85034b19a5b83da5144de6be (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.565434 9695 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5c663f3b944214bdc1cb97f2056c3b (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.584395 9709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88cb5e5e85034b19a5b83da5144de6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.584554 9699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7ab4b4ef882419189c7573251047f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.584124 9700 tablet_service.cc:1467] Processing CreateTablet for tablet a190505d090d48449d98105ee3cf265f (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.584789 9700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a190505d090d48449d98105ee3cf265f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.584959 9695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5c663f3b944214bdc1cb97f2056c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.559429 9828 tablet_service.cc:1467] Processing CreateTablet for tablet 4ba36f9bccbd4ca6968e9d2376439673 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.585245 9828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ba36f9bccbd4ca6968e9d2376439673. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.586401 9832 tablet_service.cc:1467] Processing CreateTablet for tablet 01dcdd9559db4734ab95f1ec241c58a2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.586673 9832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dcdd9559db4734ab95f1ec241c58a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.565965 9710 tablet_service.cc:1467] Processing CreateTablet for tablet bfc3de218c34422f95da14f9b33bd822 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.587314 9710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfc3de218c34422f95da14f9b33bd822. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.589007 9958 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5c663f3b944214bdc1cb97f2056c3b (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.589401 9972 tablet_service.cc:1467] Processing CreateTablet for tablet bfc3de218c34422f95da14f9b33bd822 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.559319 9824 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5c663f3b944214bdc1cb97f2056c3b (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 20:45:30.589994 9824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5c663f3b944214bdc1cb97f2056c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.564793 9707 tablet_service.cc:1467] Processing CreateTablet for tablet d8f6444b9ad741e786a07b7c5e0ebabc (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.564792 9711 tablet_service.cc:1467] Processing CreateTablet for tablet 037c78e49d4a476d99e41830b69f6909 (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.591836 9707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f6444b9ad741e786a07b7c5e0ebabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.591960 9711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 037c78e49d4a476d99e41830b69f6909. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.557447 9971 tablet_service.cc:1467] Processing CreateTablet for tablet 88cb5e5e85034b19a5b83da5144de6be (DEFAULT_TABLE table=rebalance_test_table_0 [id=10738aa18e4d430188339ab516686d62]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 20:45:30.595121 9973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 037c78e49d4a476d99e41830b69f6909. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.595571 9964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4cf4710ff63a4b2e941051de4ddc87e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.596042 10057 tablet_bootstrap.cc:492] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.596355 9971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88cb5e5e85034b19a5b83da5144de6be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.597210 9963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01dcdd9559db4734ab95f1ec241c58a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.597390 10058 tablet_bootstrap.cc:492] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.599061 10057 tablet_bootstrap.cc:654] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.599910 9962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a190505d090d48449d98105ee3cf265f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.599985 10058 tablet_bootstrap.cc:654] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.600019 10057 log.cc:824] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:30.600817 10058 log.cc:824] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:30.601773 9961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7ab4b4ef882419189c7573251047f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.602952 10058 tablet_bootstrap.cc:492] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.603014 9965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 992494c112194a06b01ebe322edc4bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.603204 10058 ts_tablet_manager.cc:1367] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20240502 20:45:30.603814 9967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3744180ae7fe4cbc96a28c2d48aaea36. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.604633 9960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 241fc777dd3b42aaadaa191e58104004. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.605051 9968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7505a36f7f6240beba4174043f5c4e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.605788 9966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50c4744713b74e5b921891bbb9e9f51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.606781 9959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ba36f9bccbd4ca6968e9d2376439673. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.606972 9969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f6444b9ad741e786a07b7c5e0ebabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.607126 9958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5c663f3b944214bdc1cb97f2056c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.608662 10058 raft_consensus.cc:348] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.609009 10058 raft_consensus.cc:374] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.609109 10058 raft_consensus.cc:729] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.609375 9972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfc3de218c34422f95da14f9b33bd822. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.609694 9970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c57b12ce15d4e958c6486ebec50d90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:30.609709 10058 consensus_queue.cc:260] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.610940 10058 ts_tablet_manager.cc:1398] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20240502 20:45:30.611420 10058 tablet_bootstrap.cc:492] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.612670 10058 tablet_bootstrap.cc:654] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.614006 10058 tablet_bootstrap.cc:492] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.614106 10058 ts_tablet_manager.cc:1367] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.614456 10057 tablet_bootstrap.cc:492] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.614668 10057 ts_tablet_manager.cc:1367] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.000s
I20240502 20:45:30.614708 10058 raft_consensus.cc:348] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.614813 10058 raft_consensus.cc:374] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.614848 10058 raft_consensus.cc:729] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.614997 10058 consensus_queue.cc:260] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.615249 10058 ts_tablet_manager.cc:1398] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.615438 10058 tablet_bootstrap.cc:492] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.615509 10061 tablet_bootstrap.cc:492] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.616534 10058 tablet_bootstrap.cc:654] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.618058 10061 tablet_bootstrap.cc:654] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.618285 10058 tablet_bootstrap.cc:492] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.618377 10058 ts_tablet_manager.cc:1367] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.618567 10057 raft_consensus.cc:348] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.618808 10057 raft_consensus.cc:374] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.618872 10057 raft_consensus.cc:729] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.618844 10058 raft_consensus.cc:348] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.618937 10058 raft_consensus.cc:374] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.618966 10058 raft_consensus.cc:729] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.619029 10061 log.cc:824] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:30.619081 10058 consensus_queue.cc:260] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.619359 10058 ts_tablet_manager.cc:1398] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.619380 10057 consensus_queue.cc:260] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.619524 10058 tablet_bootstrap.cc:492] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.620398 10057 ts_tablet_manager.cc:1398] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20240502 20:45:30.620517 10058 tablet_bootstrap.cc:654] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.621152 10061 tablet_bootstrap.cc:492] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.621369 10061 ts_tablet_manager.cc:1367] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
W20240502 20:45:30.621472 9778 tablet.cc:2369] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:45:30.621865 10057 tablet_bootstrap.cc:492] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.622879 10057 tablet_bootstrap.cc:654] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.624265 10057 tablet_bootstrap.cc:492] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.624456 10057 ts_tablet_manager.cc:1367] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.624945 10058 tablet_bootstrap.cc:492] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.625051 10058 ts_tablet_manager.cc:1367] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:45:30.625027 10061 raft_consensus.cc:348] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.625358 10061 raft_consensus.cc:374] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.625375 10057 raft_consensus.cc:348] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.625452 10061 raft_consensus.cc:729] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.625587 10057 raft_consensus.cc:374] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.625555 10058 raft_consensus.cc:348] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.625648 10058 raft_consensus.cc:374] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.625691 10058 raft_consensus.cc:729] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.625816 10057 raft_consensus.cc:729] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.625809 10058 consensus_queue.cc:260] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.625960 10061 consensus_queue.cc:260] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.626093 10058 ts_tablet_manager.cc:1398] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.626046 10057 consensus_queue.cc:260] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.626273 10058 tablet_bootstrap.cc:492] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.626381 10057 ts_tablet_manager.cc:1398] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:30.627014 10061 ts_tablet_manager.cc:1398] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20240502 20:45:30.627267 10058 tablet_bootstrap.cc:654] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.627306 10061 tablet_bootstrap.cc:492] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.628407 10061 tablet_bootstrap.cc:654] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.628582 10057 tablet_bootstrap.cc:492] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.629376 10058 tablet_bootstrap.cc:492] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.629482 10058 ts_tablet_manager.cc:1367] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.629945 10061 tablet_bootstrap.cc:492] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.630046 10061 ts_tablet_manager.cc:1367] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.630028 10058 raft_consensus.cc:348] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.630154 10058 raft_consensus.cc:374] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.630075 10057 tablet_bootstrap.cc:654] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.630208 10058 raft_consensus.cc:729] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.630337 10058 consensus_queue.cc:260] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.630609 10058 ts_tablet_manager.cc:1398] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.630643 10061 raft_consensus.cc:348] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.630753 10061 raft_consensus.cc:374] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.630785 10061 raft_consensus.cc:729] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.630816 10058 tablet_bootstrap.cc:492] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.630905 10061 consensus_queue.cc:260] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.631145 10061 ts_tablet_manager.cc:1398] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.631328 10061 tablet_bootstrap.cc:492] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.631793 10058 tablet_bootstrap.cc:654] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.632416 10061 tablet_bootstrap.cc:654] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.632802 10057 tablet_bootstrap.cc:492] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.632902 10057 ts_tablet_manager.cc:1367] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:30.633399 10058 tablet_bootstrap.cc:492] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.633481 10058 ts_tablet_manager.cc:1367] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.633451 10057 raft_consensus.cc:348] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.633594 10057 raft_consensus.cc:374] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.633627 10057 raft_consensus.cc:729] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.633745 10057 consensus_queue.cc:260] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.634008 10058 raft_consensus.cc:348] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.634102 10061 tablet_bootstrap.cc:492] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.634105 10058 raft_consensus.cc:374] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.634138 10058 raft_consensus.cc:729] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.634176 10061 ts_tablet_manager.cc:1367] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:45:30.634181 10057 ts_tablet_manager.cc:1398] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.634245 10058 consensus_queue.cc:260] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.634373 10057 tablet_bootstrap.cc:492] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.634516 10058 ts_tablet_manager.cc:1398] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.634672 10058 tablet_bootstrap.cc:492] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.634671 10061 raft_consensus.cc:348] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } }
I20240502 20:45:30.634765 10061 raft_consensus.cc:374] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.634795 10061 raft_consensus.cc:729] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.634907 10061 consensus_queue.cc:260] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } }
I20240502 20:45:30.635193 10061 ts_tablet_manager.cc:1398] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:30.635370 10061 tablet_bootstrap.cc:492] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.635398 10057 tablet_bootstrap.cc:654] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.635605 10058 tablet_bootstrap.cc:654] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.636421 10061 tablet_bootstrap.cc:654] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.637686 10058 tablet_bootstrap.cc:492] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.637779 10058 ts_tablet_manager.cc:1367] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240502 20:45:30.638245 10058 raft_consensus.cc:348] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.638306 10057 tablet_bootstrap.cc:492] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.638367 10058 raft_consensus.cc:374] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.638397 10058 raft_consensus.cc:729] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.638413 10057 ts_tablet_manager.cc:1367] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:30.638509 10058 consensus_queue.cc:260] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.638736 10058 ts_tablet_manager.cc:1398] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.638887 10058 tablet_bootstrap.cc:492] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.638895 10057 raft_consensus.cc:348] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.639021 10057 raft_consensus.cc:374] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.639063 10057 raft_consensus.cc:729] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.639185 10057 consensus_queue.cc:260] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.639456 10057 ts_tablet_manager.cc:1398] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.639636 10057 tablet_bootstrap.cc:492] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.639875 10058 tablet_bootstrap.cc:654] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.640928 10061 tablet_bootstrap.cc:492] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.640944 10057 tablet_bootstrap.cc:654] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.641034 10061 ts_tablet_manager.cc:1367] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 20:45:30.641500 10061 raft_consensus.cc:348] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.641623 10061 raft_consensus.cc:374] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.641654 10061 raft_consensus.cc:729] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.641772 10061 consensus_queue.cc:260] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.642007 10061 ts_tablet_manager.cc:1398] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.642168 10061 tablet_bootstrap.cc:492] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.643244 10061 tablet_bootstrap.cc:654] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.643477 10057 tablet_bootstrap.cc:492] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.643591 10057 ts_tablet_manager.cc:1367] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 20:45:30.644344 10057 raft_consensus.cc:348] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.644503 10057 raft_consensus.cc:374] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.644547 10057 raft_consensus.cc:729] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.644636 10061 tablet_bootstrap.cc:492] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.644650 10058 tablet_bootstrap.cc:492] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.644732 10058 ts_tablet_manager.cc:1367] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20240502 20:45:30.644726 10061 ts_tablet_manager.cc:1367] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.644682 10057 consensus_queue.cc:260] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.645002 10057 ts_tablet_manager.cc:1398] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:30.645205 10057 tablet_bootstrap.cc:492] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.645232 10058 raft_consensus.cc:348] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.645232 10061 raft_consensus.cc:348] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.645349 10061 raft_consensus.cc:374] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.645344 10058 raft_consensus.cc:374] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.645382 10058 raft_consensus.cc:729] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.645382 10061 raft_consensus.cc:729] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.645514 10061 consensus_queue.cc:260] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.645517 10058 consensus_queue.cc:260] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.645781 10061 ts_tablet_manager.cc:1398] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.645805 10058 ts_tablet_manager.cc:1398] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:30.645953 10061 tablet_bootstrap.cc:492] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.645964 10058 tablet_bootstrap.cc:492] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.646335 10057 tablet_bootstrap.cc:654] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.646944 10058 tablet_bootstrap.cc:654] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.646944 10061 tablet_bootstrap.cc:654] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.648700 10058 tablet_bootstrap.cc:492] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.648743 10061 tablet_bootstrap.cc:492] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.648811 10058 ts_tablet_manager.cc:1367] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:45:30.648810 10061 ts_tablet_manager.cc:1367] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.649333 10061 raft_consensus.cc:348] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.649384 10058 raft_consensus.cc:348] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.649467 10061 raft_consensus.cc:374] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.649480 10058 raft_consensus.cc:374] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.649506 10061 raft_consensus.cc:729] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.649514 10058 raft_consensus.cc:729] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.649638 10061 consensus_queue.cc:260] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.649639 10058 consensus_queue.cc:260] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.649920 10058 ts_tablet_manager.cc:1398] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.649920 10061 ts_tablet_manager.cc:1398] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.650122 10058 tablet_bootstrap.cc:492] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.650122 10061 tablet_bootstrap.cc:492] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.651116 10061 tablet_bootstrap.cc:654] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.651116 10058 tablet_bootstrap.cc:654] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.652503 10057 tablet_bootstrap.cc:492] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.652626 10057 ts_tablet_manager.cc:1367] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20240502 20:45:30.652861 10058 tablet_bootstrap.cc:492] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.652951 10058 ts_tablet_manager.cc:1367] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.653188 10057 raft_consensus.cc:348] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.653334 10057 raft_consensus.cc:374] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.653398 10057 raft_consensus.cc:729] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.653401 10058 raft_consensus.cc:348] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.653508 10058 raft_consensus.cc:374] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.653532 10061 tablet_bootstrap.cc:492] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.653545 10058 raft_consensus.cc:729] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.653554 10057 consensus_queue.cc:260] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.653635 10061 ts_tablet_manager.cc:1367] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:30.653659 10058 consensus_queue.cc:260] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.653851 10057 ts_tablet_manager.cc:1398] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.653959 10058 ts_tablet_manager.cc:1398] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.654049 10057 tablet_bootstrap.cc:492] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.654117 10058 tablet_bootstrap.cc:492] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.654227 10061 raft_consensus.cc:348] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.654345 10061 raft_consensus.cc:374] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.654382 10061 raft_consensus.cc:729] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.654511 10061 consensus_queue.cc:260] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.655066 10058 tablet_bootstrap.cc:654] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.655066 10057 tablet_bootstrap.cc:654] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.655354 10061 ts_tablet_manager.cc:1398] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:30.655545 10061 tablet_bootstrap.cc:492] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.657109 10058 tablet_bootstrap.cc:492] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.657215 10058 ts_tablet_manager.cc:1367] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:45:30.657426 10057 tablet_bootstrap.cc:492] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.657557 10057 ts_tablet_manager.cc:1367] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240502 20:45:30.657771 10061 tablet_bootstrap.cc:654] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.657727 10058 raft_consensus.cc:348] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.657835 10058 raft_consensus.cc:374] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.657876 10058 raft_consensus.cc:729] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.658008 10058 consensus_queue.cc:260] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.658286 10058 ts_tablet_manager.cc:1398] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.658473 10058 tablet_bootstrap.cc:492] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.658485 10057 raft_consensus.cc:348] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.658695 10057 raft_consensus.cc:374] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.658788 10057 raft_consensus.cc:729] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.658970 10057 consensus_queue.cc:260] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.659018 10061 tablet_bootstrap.cc:492] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.659111 10061 ts_tablet_manager.cc:1367] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:30.659336 10057 ts_tablet_manager.cc:1398] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:30.659525 10058 tablet_bootstrap.cc:654] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.659631 10057 tablet_bootstrap.cc:492] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.659587 10061 raft_consensus.cc:348] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.659749 10061 raft_consensus.cc:374] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.659803 10061 raft_consensus.cc:729] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.659947 10061 consensus_queue.cc:260] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.660224 10061 ts_tablet_manager.cc:1398] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:30.660387 10061 tablet_bootstrap.cc:492] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.660674 10057 tablet_bootstrap.cc:654] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.661353 10061 tablet_bootstrap.cc:654] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.661782 10057 tablet_bootstrap.cc:492] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.661859 10057 ts_tablet_manager.cc:1367] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:30.662361 10057 raft_consensus.cc:348] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.662492 10057 raft_consensus.cc:374] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.662532 10057 raft_consensus.cc:729] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.662672 10057 consensus_queue.cc:260] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.663043 10057 ts_tablet_manager.cc:1398] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.663214 10057 tablet_bootstrap.cc:492] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.663450 10058 tablet_bootstrap.cc:492] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.663528 10058 ts_tablet_manager.cc:1367] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:45:30.664049 10058 raft_consensus.cc:348] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.664165 10058 raft_consensus.cc:374] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.664206 10058 raft_consensus.cc:729] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.664220 10057 tablet_bootstrap.cc:654] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.664333 10058 consensus_queue.cc:260] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.664644 10058 ts_tablet_manager.cc:1398] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.664841 10058 tablet_bootstrap.cc:492] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.665514 10061 tablet_bootstrap.cc:492] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.665663 10061 ts_tablet_manager.cc:1367] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240502 20:45:30.665990 10058 tablet_bootstrap.cc:654] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.666491 10061 raft_consensus.cc:348] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.666658 10061 raft_consensus.cc:374] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.666709 10061 raft_consensus.cc:729] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.666849 10061 consensus_queue.cc:260] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.666972 10057 tablet_bootstrap.cc:492] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.667060 10057 ts_tablet_manager.cc:1367] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:30.667168 10061 ts_tablet_manager.cc:1398] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:30.667344 10058 tablet_bootstrap.cc:492] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.667380 10061 tablet_bootstrap.cc:492] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.667428 10058 ts_tablet_manager.cc:1367] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.667518 10057 raft_consensus.cc:348] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.667629 10057 raft_consensus.cc:374] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.667665 10057 raft_consensus.cc:729] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.667820 10057 consensus_queue.cc:260] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.667958 10058 raft_consensus.cc:348] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.668064 10058 raft_consensus.cc:374] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.668095 10058 raft_consensus.cc:729] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.668228 10057 ts_tablet_manager.cc:1398] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.668236 10058 consensus_queue.cc:260] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.668407 10061 tablet_bootstrap.cc:654] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.668668 10058 ts_tablet_manager.cc:1398] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.668857 10058 tablet_bootstrap.cc:492] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.669066 10057 tablet_bootstrap.cc:492] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.669194 10069 raft_consensus.cc:482] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.669344 10069 raft_consensus.cc:504] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.670230 10057 tablet_bootstrap.cc:654] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.670713 10069 leader_election.cc:288] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171)
I20240502 20:45:30.670728 10061 tablet_bootstrap.cc:492] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.670867 10061 ts_tablet_manager.cc:1367] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240502 20:45:30.671233 10061 raft_consensus.cc:348] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.671343 10061 raft_consensus.cc:374] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.671375 10061 raft_consensus.cc:729] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.671478 10061 consensus_queue.cc:260] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.671792 10061 ts_tablet_manager.cc:1398] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.671988 10061 tablet_bootstrap.cc:492] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.671989 10057 tablet_bootstrap.cc:492] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.672073 10057 ts_tablet_manager.cc:1367] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.672519 10057 raft_consensus.cc:348] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.672605 10057 raft_consensus.cc:374] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.672652 10057 raft_consensus.cc:729] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.672804 10057 consensus_queue.cc:260] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.673030 10061 tablet_bootstrap.cc:654] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.673094 10057 ts_tablet_manager.cc:1398] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.673243 10057 tablet_bootstrap.cc:492] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.674239 10057 tablet_bootstrap.cc:654] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.674834 10061 tablet_bootstrap.cc:492] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.674938 10061 ts_tablet_manager.cc:1367] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.675523 10061 raft_consensus.cc:348] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.675664 10061 raft_consensus.cc:374] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.675742 10061 raft_consensus.cc:729] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.675917 10061 consensus_queue.cc:260] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.676249 10061 ts_tablet_manager.cc:1398] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:45:30.676496 10061 tablet_bootstrap.cc:492] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.676995 10062 raft_consensus.cc:482] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.677186 10062 raft_consensus.cc:504] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.677524 10061 tablet_bootstrap.cc:654] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.677556 10058 tablet_bootstrap.cc:654] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.678668 10062 leader_election.cc:288] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.678800 10062 raft_consensus.cc:482] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.678875 10062 raft_consensus.cc:504] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.679303 10062 leader_election.cc:288] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.679807 10057 tablet_bootstrap.cc:492] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.679917 10057 ts_tablet_manager.cc:1367] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 20:45:30.680469 10057 raft_consensus.cc:348] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.680600 10057 raft_consensus.cc:374] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.680639 10057 raft_consensus.cc:729] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.680820 10057 consensus_queue.cc:260] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.681162 10057 ts_tablet_manager.cc:1398] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.681351 10057 tablet_bootstrap.cc:492] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.682452 10057 tablet_bootstrap.cc:654] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.683655 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcdd9559db4734ab95f1ec241c58a2" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" is_pre_election: true
I20240502 20:45:30.683969 9731 raft_consensus.cc:2454] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 0.
I20240502 20:45:30.683929 9862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcdd9559db4734ab95f1ec241c58a2" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.684237 9862 raft_consensus.cc:2454] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 0.
I20240502 20:45:30.684494 9927 leader_election.cc:302] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.684971 10057 tablet_bootstrap.cc:492] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.685051 10057 ts_tablet_manager.cc:1367] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:30.685261 10069 raft_consensus.cc:2781] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.685354 10069 raft_consensus.cc:482] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.685395 10069 raft_consensus.cc:3037] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.685778 10057 raft_consensus.cc:348] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.685886 10057 raft_consensus.cc:374] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.685914 10057 raft_consensus.cc:729] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.686062 10057 consensus_queue.cc:260] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.688326 10057 ts_tablet_manager.cc:1398] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.688570 10057 tablet_bootstrap.cc:492] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.688654 9861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcdd9559db4734ab95f1ec241c58a2" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.688807 9861 raft_consensus.cc:2454] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.689087 10061 tablet_bootstrap.cc:492] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.689100 10058 tablet_bootstrap.cc:492] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.689184 10061 ts_tablet_manager.cc:1367] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 20:45:30.689196 10058 ts_tablet_manager.cc:1367] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.002s
I20240502 20:45:30.689213 9665 leader_election.cc:302] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.689536 9862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3744180ae7fe4cbc96a28c2d48aaea36" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.689638 9862 raft_consensus.cc:2454] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.689661 10057 tablet_bootstrap.cc:654] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.689685 10061 raft_consensus.cc:348] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.689713 10058 raft_consensus.cc:348] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.689787 10061 raft_consensus.cc:374] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.689831 10058 raft_consensus.cc:374] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.689829 10061 raft_consensus.cc:729] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.689867 10058 raft_consensus.cc:729] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.689947 9665 leader_election.cc:302] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.689973 10061 consensus_queue.cc:260] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.689993 10058 consensus_queue.cc:260] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.690412 10058 ts_tablet_manager.cc:1398] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 20:45:30.690414 10061 ts_tablet_manager.cc:1398] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.690532 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3744180ae7fe4cbc96a28c2d48aaea36" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.690588 10061 tablet_bootstrap.cc:492] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.690604 10058 tablet_bootstrap.cc:492] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.690721 9993 raft_consensus.cc:2454] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.691037 9992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcdd9559db4734ab95f1ec241c58a2" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.691566 10061 tablet_bootstrap.cc:654] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.691581 10058 tablet_bootstrap.cc:654] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.691630 10062 raft_consensus.cc:2781] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.691694 10062 raft_consensus.cc:482] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.691800 10062 raft_consensus.cc:3037] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.692688 10100 raft_consensus.cc:2781] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.692785 10100 raft_consensus.cc:482] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.692865 10100 raft_consensus.cc:3037] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.693984 10058 tablet_bootstrap.cc:492] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.694089 10058 ts_tablet_manager.cc:1367] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240502 20:45:30.694087 10057 tablet_bootstrap.cc:492] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.694198 10057 ts_tablet_manager.cc:1367] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:45:30.694574 10058 raft_consensus.cc:348] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } }
I20240502 20:45:30.694715 10058 raft_consensus.cc:374] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.694684 10057 raft_consensus.cc:348] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.694756 10058 raft_consensus.cc:729] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.694795 10057 raft_consensus.cc:374] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.694864 10057 raft_consensus.cc:729] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.694890 10058 consensus_queue.cc:260] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } }
I20240502 20:45:30.695030 10057 consensus_queue.cc:260] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.695283 10058 ts_tablet_manager.cc:1398] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:30.695348 10057 ts_tablet_manager.cc:1398] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.695490 10058 tablet_bootstrap.cc:492] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Bootstrap starting.
I20240502 20:45:30.695524 10057 tablet_bootstrap.cc:492] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.696571 10058 tablet_bootstrap.cc:654] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.697336 10057 tablet_bootstrap.cc:654] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.698303 10058 tablet_bootstrap.cc:492] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e: No bootstrap required, opened a new log
I20240502 20:45:30.698387 10058 ts_tablet_manager.cc:1367] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.698484 10061 tablet_bootstrap.cc:492] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.698597 10061 ts_tablet_manager.cc:1367] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 20:45:30.698872 10058 raft_consensus.cc:348] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.698977 10058 raft_consensus.cc:374] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.699008 10058 raft_consensus.cc:729] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.699119 10058 consensus_queue.cc:260] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.699115 10061 raft_consensus.cc:348] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.699226 10061 raft_consensus.cc:374] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.699263 10061 raft_consensus.cc:729] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.699426 10058 ts_tablet_manager.cc:1398] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.699406 10061 consensus_queue.cc:260] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.699688 10061 ts_tablet_manager.cc:1398] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.699940 10057 tablet_bootstrap.cc:492] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.699965 10061 tablet_bootstrap.cc:492] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.700038 10057 ts_tablet_manager.cc:1367] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 20:45:30.700488 10057 raft_consensus.cc:348] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.700594 10057 raft_consensus.cc:374] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.700624 10057 raft_consensus.cc:729] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.700779 10057 consensus_queue.cc:260] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.701018 10061 tablet_bootstrap.cc:654] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.702020 10057 ts_tablet_manager.cc:1398] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:30.702216 10057 tablet_bootstrap.cc:492] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.703193 10061 tablet_bootstrap.cc:492] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.703320 10061 ts_tablet_manager.cc:1367] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:45:30.703824 10057 tablet_bootstrap.cc:654] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.703866 10061 raft_consensus.cc:348] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.703984 10061 raft_consensus.cc:374] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.704035 10061 raft_consensus.cc:729] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.704176 10061 consensus_queue.cc:260] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.704499 10061 ts_tablet_manager.cc:1398] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.704725 10061 tablet_bootstrap.cc:492] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.705063 10057 tablet_bootstrap.cc:492] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.705168 10057 ts_tablet_manager.cc:1367] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:45:30.705669 10057 raft_consensus.cc:348] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } }
I20240502 20:45:30.705729 10061 tablet_bootstrap.cc:654] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.705765 10057 raft_consensus.cc:374] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.705799 10057 raft_consensus.cc:729] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.705926 10057 consensus_queue.cc:260] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } }
I20240502 20:45:30.706176 10057 ts_tablet_manager.cc:1398] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:30.706357 10057 tablet_bootstrap.cc:492] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84: Bootstrap starting.
I20240502 20:45:30.707275 10061 tablet_bootstrap.cc:492] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.707377 10061 ts_tablet_manager.cc:1367] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:45:30.707476 10057 tablet_bootstrap.cc:654] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.707913 10107 raft_consensus.cc:482] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.707935 10061 raft_consensus.cc:348] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.708048 10061 raft_consensus.cc:374] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.708092 10061 raft_consensus.cc:729] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.708036 10107 raft_consensus.cc:504] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.708231 10061 consensus_queue.cc:260] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.708534 10061 ts_tablet_manager.cc:1398] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.708729 10061 tablet_bootstrap.cc:492] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3: Bootstrap starting.
I20240502 20:45:30.708879 9862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c57b12ce15d4e958c6486ebec50d90f" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.708998 9862 raft_consensus.cc:2454] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.709322 9665 leader_election.cc:302] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.709475 10057 tablet_bootstrap.cc:492] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84: No bootstrap required, opened a new log
I20240502 20:45:30.709551 10057 ts_tablet_manager.cc:1367] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:30.709735 10061 tablet_bootstrap.cc:654] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:30.710001 10057 raft_consensus.cc:348] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.710122 10057 raft_consensus.cc:374] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.710158 10057 raft_consensus.cc:729] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.710273 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c57b12ce15d4e958c6486ebec50d90f" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.710321 10057 consensus_queue.cc:260] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.710397 9993 raft_consensus.cc:2454] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.710637 10057 ts_tablet_manager.cc:1398] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:30.711639 10107 leader_election.cc:288] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.711915 10107 raft_consensus.cc:2781] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.711977 10107 raft_consensus.cc:482] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.712019 10107 raft_consensus.cc:3037] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.713384 10061 tablet_bootstrap.cc:492] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3: No bootstrap required, opened a new log
I20240502 20:45:30.713477 10061 ts_tablet_manager.cc:1367] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:45:30.714017 10061 raft_consensus.cc:348] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.714145 10061 raft_consensus.cc:374] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:30.714185 10061 raft_consensus.cc:729] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Initialized, Role: FOLLOWER
I20240502 20:45:30.714342 10061 consensus_queue.cc:260] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.714627 10061 ts_tablet_manager.cc:1398] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:30.725243 10118 raft_consensus.cc:482] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.725401 10118 raft_consensus.cc:504] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } }
I20240502 20:45:30.725828 10118 leader_election.cc:288] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815), 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951)
I20240502 20:45:30.726444 9862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "037c78e49d4a476d99e41830b69f6909" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.726444 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "037c78e49d4a476d99e41830b69f6909" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.726621 9862 raft_consensus.cc:2454] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.726621 9993 raft_consensus.cc:2454] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.727013 9665 leader_election.cc:302] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.727205 10118 raft_consensus.cc:2781] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.727272 10118 raft_consensus.cc:482] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.727345 10118 raft_consensus.cc:3037] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.742148 10069 raft_consensus.cc:504] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.742165 10062 raft_consensus.cc:504] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.742764 10069 leader_election.cc:288] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 election: Requested vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171)
I20240502 20:45:30.742759 10062 leader_election.cc:288] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Requested vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.743059 9992 raft_consensus.cc:2379] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in current term 1: Already voted for candidate 3d6a8733c1744c1b86231135574cd4f3 in this term.
I20240502 20:45:30.743180 10100 raft_consensus.cc:504] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.743542 10100 leader_election.cc:288] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Requested vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.744264 9862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcdd9559db4734ab95f1ec241c58a2" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:30.744323 9861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcdd9559db4734ab95f1ec241c58a2" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:30.744432 9862 raft_consensus.cc:3037] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.744588 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcdd9559db4734ab95f1ec241c58a2" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
I20240502 20:45:30.744634 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3744180ae7fe4cbc96a28c2d48aaea36" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:30.744760 9731 raft_consensus.cc:2379] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d6a8733c1744c1b86231135574cd4f3 in current term 1: Already voted for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in this term.
I20240502 20:45:30.744802 9993 raft_consensus.cc:3037] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.744436 9860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3744180ae7fe4cbc96a28c2d48aaea36" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:30.745124 9860 raft_consensus.cc:3037] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.745765 9992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01dcdd9559db4734ab95f1ec241c58a2" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:30.745929 9992 raft_consensus.cc:2379] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in current term 1: Already voted for candidate 3d6a8733c1744c1b86231135574cd4f3 in this term.
I20240502 20:45:30.746325 9665 leader_election.cc:302] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters: 3d6a8733c1744c1b86231135574cd4f3, 807a93eca2cf4b17906c4c6febcdea84
I20240502 20:45:30.746554 10100 raft_consensus.cc:2726] T 01dcdd9559db4734ab95f1ec241c58a2 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20240502 20:45:30.749670 10040 tablet.cc:2369] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:45:30.752290 10066 raft_consensus.cc:482] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.752440 10066 raft_consensus.cc:504] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.753535 10066 leader_election.cc:288] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.758033 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "241fc777dd3b42aaadaa191e58104004" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" is_pre_election: true
I20240502 20:45:30.758210 9731 raft_consensus.cc:2454] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.758637 9992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "241fc777dd3b42aaadaa191e58104004" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.758666 9796 leader_election.cc:302] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.758782 9992 raft_consensus.cc:2454] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.759018 10066 raft_consensus.cc:2781] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.759089 10066 raft_consensus.cc:482] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.759130 10066 raft_consensus.cc:3037] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.770536 10069 raft_consensus.cc:482] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.770691 10069 raft_consensus.cc:504] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.771099 10069 leader_election.cc:288] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951)
I20240502 20:45:30.771736 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "992494c112194a06b01ebe322edc4bbf" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" is_pre_election: true
I20240502 20:45:30.771740 9861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "992494c112194a06b01ebe322edc4bbf" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.771934 9861 raft_consensus.cc:2454] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 0.
I20240502 20:45:30.771932 9731 raft_consensus.cc:2454] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 0.
I20240502 20:45:30.772279 9927 leader_election.cc:302] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.772536 10069 raft_consensus.cc:2781] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.772609 10069 raft_consensus.cc:482] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.772639 10069 raft_consensus.cc:3037] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.776878 10100 raft_consensus.cc:482] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.777025 10100 raft_consensus.cc:504] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.777550 10100 leader_election.cc:288] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.778190 9992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c4744713b74e5b921891bbb9e9f51d" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.778208 9861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c4744713b74e5b921891bbb9e9f51d" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.778338 9992 raft_consensus.cc:2454] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.778348 9861 raft_consensus.cc:2454] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.778704 9665 leader_election.cc:302] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.778918 10100 raft_consensus.cc:2781] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.778985 10100 raft_consensus.cc:482] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.779016 10100 raft_consensus.cc:3037] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.790338 10122 raft_consensus.cc:482] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.790558 10122 raft_consensus.cc:504] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.790675 9993 raft_consensus.cc:2454] T 3744180ae7fe4cbc96a28c2d48aaea36 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:30.790683 10107 raft_consensus.cc:504] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.791126 9862 raft_consensus.cc:2454] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 1.
I20240502 20:45:30.791158 10122 leader_election.cc:288] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.791209 10107 leader_election.cc:288] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Requested vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.791491 9860 raft_consensus.cc:2454] T 3744180ae7fe4cbc96a28c2d48aaea36 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:30.792518 10066 raft_consensus.cc:504] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.792519 10100 raft_consensus.cc:504] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.792883 10066 leader_election.cc:288] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Requested vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.792906 10100 leader_election.cc:288] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Requested vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.792863 10118 raft_consensus.cc:504] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } }
I20240502 20:45:30.793243 9665 leader_election.cc:302] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.793258 10118 leader_election.cc:288] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Requested vote from peers 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815), 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951)
I20240502 20:45:30.793480 9927 leader_election.cc:302] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 807a93eca2cf4b17906c4c6febcdea84; no voters: 95ed5d5c7d9a4441a96ad06d82b3fd7e
I20240502 20:45:30.793555 10118 raft_consensus.cc:2781] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:30.793645 10118 raft_consensus.cc:686] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 LEADER]: Becoming Leader. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Running, Role: LEADER
I20240502 20:45:30.793742 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c57b12ce15d4e958c6486ebec50d90f" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:30.793864 9993 raft_consensus.cc:3037] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.793962 10108 raft_consensus.cc:2781] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:30.794055 10118 consensus_queue.cc:237] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.794191 10108 raft_consensus.cc:686] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Running, Role: LEADER
I20240502 20:45:30.794500 10108 consensus_queue.cc:237] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.794929 9993 raft_consensus.cc:2454] T 6c57b12ce15d4e958c6486ebec50d90f P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:30.796015 9992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c4744713b74e5b921891bbb9e9f51d" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:30.796136 9992 raft_consensus.cc:3037] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.796358 9991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "037c78e49d4a476d99e41830b69f6909" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:30.796475 9991 raft_consensus.cc:3037] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.797506 9861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "037c78e49d4a476d99e41830b69f6909" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:30.797631 9861 raft_consensus.cc:3037] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.797785 9730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "241fc777dd3b42aaadaa191e58104004" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
I20240502 20:45:30.797907 9730 raft_consensus.cc:3037] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.798036 10123 raft_consensus.cc:482] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.798130 10123 raft_consensus.cc:504] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.798157 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cf4710ff63a4b2e941051de4ddc87e3" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" is_pre_election: true
I20240502 20:45:30.798280 9731 raft_consensus.cc:2454] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.798460 10123 leader_election.cc:288] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171)
I20240502 20:45:30.798633 9862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c4744713b74e5b921891bbb9e9f51d" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:30.798758 9862 raft_consensus.cc:3037] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.799067 9796 leader_election.cc:302] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.799257 10066 raft_consensus.cc:2781] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.799307 10066 raft_consensus.cc:482] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.799343 10066 raft_consensus.cc:3037] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.799420 9860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c57b12ce15d4e958c6486ebec50d90f" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:30.799489 9859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc3de218c34422f95da14f9b33bd822" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.799531 9860 raft_consensus.cc:3037] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.799592 9859 raft_consensus.cc:2454] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 0.
I20240502 20:45:30.799691 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc3de218c34422f95da14f9b33bd822" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" is_pre_election: true
I20240502 20:45:30.799898 9731 raft_consensus.cc:2454] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 0.
I20240502 20:45:30.799947 9927 leader_election.cc:302] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 807a93eca2cf4b17906c4c6febcdea84; no voters:
I20240502 20:45:30.799834 9589 catalog_manager.cc:5484] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129). New cstate: current_term: 1 leader_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:30.800277 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cf4710ff63a4b2e941051de4ddc87e3" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.800313 9665 leader_election.cc:302] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.800384 9993 raft_consensus.cc:2454] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.800585 10100 raft_consensus.cc:2781] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:30.800665 10100 raft_consensus.cc:686] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 LEADER]: Becoming Leader. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Running, Role: LEADER
I20240502 20:45:30.800657 10123 raft_consensus.cc:2781] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.800711 10123 raft_consensus.cc:482] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.800755 10123 raft_consensus.cc:3037] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.800804 10100 consensus_queue.cc:237] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
W20240502 20:45:30.801082 9909 tablet.cc:2369] T 01dcdd9559db4734ab95f1ec241c58a2 P 807a93eca2cf4b17906c4c6febcdea84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:45:30.801668 9990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "241fc777dd3b42aaadaa191e58104004" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:30.801782 9990 raft_consensus.cc:3037] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.802367 9587 catalog_manager.cc:5484] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "3d6a8733c1744c1b86231135574cd4f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240502 20:45:30.804867 9589 catalog_manager.cc:5484] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129). New cstate: current_term: 1 leader_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:30.815979 10122 raft_consensus.cc:482] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.816134 10122 raft_consensus.cc:504] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.816550 10122 leader_election.cc:288] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.817135 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88cb5e5e85034b19a5b83da5144de6be" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" is_pre_election: true
I20240502 20:45:30.817188 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88cb5e5e85034b19a5b83da5144de6be" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.817322 9731 raft_consensus.cc:2454] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.817338 9993 raft_consensus.cc:2454] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.817623 9796 leader_election.cc:302] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.817799 10122 raft_consensus.cc:2781] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.817865 10122 raft_consensus.cc:482] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.817893 10122 raft_consensus.cc:3037] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.835635 10127 raft_consensus.cc:482] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.835812 10127 raft_consensus.cc:504] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.836310 10127 leader_election.cc:288] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.836838 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7ab4b4ef882419189c7573251047f12" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" is_pre_election: true
I20240502 20:45:30.836925 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7ab4b4ef882419189c7573251047f12" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.837018 9731 raft_consensus.cc:2454] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.837049 9993 raft_consensus.cc:2454] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.837363 9796 leader_election.cc:302] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.837545 10127 raft_consensus.cc:2781] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.837613 10127 raft_consensus.cc:482] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.837641 10127 raft_consensus.cc:3037] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.847115 10128 raft_consensus.cc:482] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.847247 10128 raft_consensus.cc:504] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.847714 10128 leader_election.cc:288] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.848415 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7505a36f7f6240beba4174043f5c4e39" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" is_pre_election: true
I20240502 20:45:30.848470 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7505a36f7f6240beba4174043f5c4e39" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.848598 9731 raft_consensus.cc:2454] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.848598 9993 raft_consensus.cc:2454] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:30.848912 9796 leader_election.cc:302] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.849093 10128 raft_consensus.cc:2781] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.849157 10128 raft_consensus.cc:482] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.849210 10128 raft_consensus.cc:3037] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.860677 10100 raft_consensus.cc:482] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.860841 10100 raft_consensus.cc:504] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.861267 10100 leader_election.cc:288] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.861864 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f6444b9ad741e786a07b7c5e0ebabc" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.861866 9859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f6444b9ad741e786a07b7c5e0ebabc" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.861999 9993 raft_consensus.cc:2454] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.862010 9859 raft_consensus.cc:2454] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.862339 9665 leader_election.cc:302] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.862565 10100 raft_consensus.cc:2781] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.862627 10100 raft_consensus.cc:482] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.862684 10100 raft_consensus.cc:3037] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.889031 9730 raft_consensus.cc:2454] T 241fc777dd3b42aaadaa191e58104004 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:30.889030 9861 raft_consensus.cc:2454] T 037c78e49d4a476d99e41830b69f6909 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:30.889040 10069 raft_consensus.cc:504] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.889552 10069 leader_election.cc:288] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 election: Requested vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951)
I20240502 20:45:30.890410 9862 raft_consensus.cc:2454] T 50c4744713b74e5b921891bbb9e9f51d P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:30.890551 9992 raft_consensus.cc:2454] T 50c4744713b74e5b921891bbb9e9f51d P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:30.890606 9991 raft_consensus.cc:2454] T 037c78e49d4a476d99e41830b69f6909 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:30.891511 9860 raft_consensus.cc:2454] T 6c57b12ce15d4e958c6486ebec50d90f P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:30.891479 10123 raft_consensus.cc:504] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.891605 10066 raft_consensus.cc:504] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.891862 10123 leader_election.cc:288] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 election: Requested vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171)
I20240502 20:45:30.892053 10066 leader_election.cc:288] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Requested vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.892272 9796 leader_election.cc:302] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.892571 9665 leader_election.cc:302] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.892755 9665 leader_election.cc:302] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.892789 10118 raft_consensus.cc:2781] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:30.892872 10066 raft_consensus.cc:2781] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:30.892969 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cf4710ff63a4b2e941051de4ddc87e3" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
I20240502 20:45:30.892988 9729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc3de218c34422f95da14f9b33bd822" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
I20240502 20:45:30.893076 9731 raft_consensus.cc:3037] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.893107 9729 raft_consensus.cc:3037] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.893108 10066 raft_consensus.cc:686] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 LEADER]: Becoming Leader. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Running, Role: LEADER
I20240502 20:45:30.893304 10107 raft_consensus.cc:2781] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:30.893375 10107 raft_consensus.cc:686] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 LEADER]: Becoming Leader. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Running, Role: LEADER
I20240502 20:45:30.893543 10118 raft_consensus.cc:686] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 LEADER]: Becoming Leader. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Running, Role: LEADER
I20240502 20:45:30.893513 10107 consensus_queue.cc:237] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } }
I20240502 20:45:30.893512 10066 consensus_queue.cc:237] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.893656 10118 consensus_queue.cc:237] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.894614 9860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "992494c112194a06b01ebe322edc4bbf" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:30.894731 9860 raft_consensus.cc:3037] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.894979 9991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cf4710ff63a4b2e941051de4ddc87e3" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:30.895085 9991 raft_consensus.cc:3037] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.895316 9862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc3de218c34422f95da14f9b33bd822" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:30.895424 9862 raft_consensus.cc:3037] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.895738 9730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "992494c112194a06b01ebe322edc4bbf" candidate_uuid: "3d6a8733c1744c1b86231135574cd4f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
I20240502 20:45:30.895848 9730 raft_consensus.cc:3037] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.896014 9589 catalog_manager.cc:5484] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129). New cstate: current_term: 1 leader_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:30.896385 9589 catalog_manager.cc:5484] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129). New cstate: current_term: 1 leader_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:30.896950 9587 catalog_manager.cc:5484] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "807a93eca2cf4b17906c4c6febcdea84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:30.939909 10107 raft_consensus.cc:482] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:30.940076 10107 raft_consensus.cc:504] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.940555 10107 leader_election.cc:288] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.941097 9992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a190505d090d48449d98105ee3cf265f" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:30.941085 9861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a190505d090d48449d98105ee3cf265f" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:30.941251 9992 raft_consensus.cc:2454] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.941244 9861 raft_consensus.cc:2454] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:30.941576 9665 leader_election.cc:302] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.941742 10107 raft_consensus.cc:2781] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:30.941803 10107 raft_consensus.cc:482] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:30.941851 10107 raft_consensus.cc:3037] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.979964 9990 raft_consensus.cc:2454] T 241fc777dd3b42aaadaa191e58104004 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:30.979967 10122 raft_consensus.cc:504] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.979967 10100 raft_consensus.cc:504] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.980520 10100 leader_election.cc:288] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Requested vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.980520 10122 leader_election.cc:288] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Requested vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:30.981323 9861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f6444b9ad741e786a07b7c5e0ebabc" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:30.981457 9861 raft_consensus.cc:3037] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.981830 9731 raft_consensus.cc:2454] T 4cf4710ff63a4b2e941051de4ddc87e3 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:30.982311 9991 raft_consensus.cc:2454] T 4cf4710ff63a4b2e941051de4ddc87e3 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:30.982336 9796 leader_election.cc:302] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:30.982600 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88cb5e5e85034b19a5b83da5144de6be" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
I20240502 20:45:30.982714 9731 raft_consensus.cc:3037] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.983671 10122 raft_consensus.cc:2781] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:30.983793 10122 raft_consensus.cc:686] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 LEADER]: Becoming Leader. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Running, Role: LEADER
I20240502 20:45:30.983964 10122 consensus_queue.cc:237] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:30.984185 9990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88cb5e5e85034b19a5b83da5144de6be" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:30.984310 9990 raft_consensus.cc:3037] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.985502 9991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f6444b9ad741e786a07b7c5e0ebabc" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:30.985636 9991 raft_consensus.cc:3037] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:30.986115 9587 catalog_manager.cc:5484] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "807a93eca2cf4b17906c4c6febcdea84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:31.035713 10100 raft_consensus.cc:482] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:31.035923 10100 raft_consensus.cc:504] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.036361 10100 leader_election.cc:288] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:31.036890 9859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ba36f9bccbd4ca6968e9d2376439673" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84" is_pre_election: true
I20240502 20:45:31.036916 9992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ba36f9bccbd4ca6968e9d2376439673" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:31.037035 9859 raft_consensus.cc:2454] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:31.037060 9992 raft_consensus.cc:2454] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 0.
I20240502 20:45:31.037356 9665 leader_election.cc:302] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:31.037568 10100 raft_consensus.cc:2781] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:31.037642 10100 raft_consensus.cc:482] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:31.037703 10100 raft_consensus.cc:3037] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.064666 10122 raft_consensus.cc:482] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:31.064815 10122 raft_consensus.cc:504] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.065253 10122 leader_election.cc:288] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:31.065840 9728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5c663f3b944214bdc1cb97f2056c3b" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" is_pre_election: true
I20240502 20:45:31.065922 9992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5c663f3b944214bdc1cb97f2056c3b" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3" is_pre_election: true
I20240502 20:45:31.065999 9728 raft_consensus.cc:2454] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:31.066073 9992 raft_consensus.cc:2454] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 0.
I20240502 20:45:31.066376 9796 leader_election.cc:302] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 807a93eca2cf4b17906c4c6febcdea84; no voters:
I20240502 20:45:31.066563 10122 raft_consensus.cc:2781] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:31.066627 10122 raft_consensus.cc:482] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:31.066682 10122 raft_consensus.cc:3037] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.073424 9861 raft_consensus.cc:2454] T d8f6444b9ad741e786a07b7c5e0ebabc P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:31.073424 9731 raft_consensus.cc:2454] T 88cb5e5e85034b19a5b83da5144de6be P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:31.073431 9990 raft_consensus.cc:2454] T 88cb5e5e85034b19a5b83da5144de6be P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:31.074005 9796 leader_election.cc:302] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:31.074455 9665 leader_election.cc:302] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:31.074762 10062 raft_consensus.cc:2781] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:31.074827 9860 raft_consensus.cc:2454] T 992494c112194a06b01ebe322edc4bbf P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 1.
I20240502 20:45:31.074873 10062 raft_consensus.cc:686] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 LEADER]: Becoming Leader. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Running, Role: LEADER
I20240502 20:45:31.074939 9991 raft_consensus.cc:2454] T d8f6444b9ad741e786a07b7c5e0ebabc P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:31.075028 10062 consensus_queue.cc:237] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.075197 10129 raft_consensus.cc:2781] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:31.075302 10129 raft_consensus.cc:686] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [term 1 LEADER]: Becoming Leader. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Running, Role: LEADER
I20240502 20:45:31.075469 10129 consensus_queue.cc:237] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.076364 9730 raft_consensus.cc:2454] T 992494c112194a06b01ebe322edc4bbf P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 1.
I20240502 20:45:31.076509 9927 leader_election.cc:302] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 807a93eca2cf4b17906c4c6febcdea84; no voters:
I20240502 20:45:31.076766 9729 raft_consensus.cc:2454] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 1.
I20240502 20:45:31.077134 10107 raft_consensus.cc:504] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.077276 9927 leader_election.cc:302] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:31.077448 10069 raft_consensus.cc:2781] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:31.077533 10069 raft_consensus.cc:686] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Running, Role: LEADER
I20240502 20:45:31.077558 10107 leader_election.cc:288] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Requested vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:31.077672 10069 consensus_queue.cc:237] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.077667 10123 raft_consensus.cc:2781] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:31.078565 10123 raft_consensus.cc:686] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3d6a8733c1744c1b86231135574cd4f3, State: Running, Role: LEADER
I20240502 20:45:31.078555 9862 raft_consensus.cc:2454] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d6a8733c1744c1b86231135574cd4f3 in term 1.
I20240502 20:45:31.078689 10123 consensus_queue.cc:237] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.079497 9991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a190505d090d48449d98105ee3cf265f" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:31.079607 9991 raft_consensus.cc:3037] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.079607 9862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a190505d090d48449d98105ee3cf265f" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:31.079748 9862 raft_consensus.cc:3037] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.080032 9587 catalog_manager.cc:5484] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "3d6a8733c1744c1b86231135574cd4f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240502 20:45:31.081265 9589 catalog_manager.cc:5484] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129). New cstate: current_term: 1 leader_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:31.081265 9588 catalog_manager.cc:5484] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "807a93eca2cf4b17906c4c6febcdea84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:31.083627 9587 catalog_manager.cc:5484] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "3d6a8733c1744c1b86231135574cd4f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240502 20:45:31.172384 9991 raft_consensus.cc:2454] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:31.172374 10128 raft_consensus.cc:504] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.172385 10100 raft_consensus.cc:504] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.172873 10128 leader_election.cc:288] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Requested vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:31.172953 10100 leader_election.cc:288] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Requested vote from peers 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130:45951), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:31.173094 10127 raft_consensus.cc:504] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.173424 10127 leader_election.cc:288] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Requested vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:31.173704 9665 leader_election.cc:302] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:31.173902 10100 raft_consensus.cc:2781] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:31.173992 10100 raft_consensus.cc:686] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 LEADER]: Becoming Leader. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Running, Role: LEADER
I20240502 20:45:31.174002 10122 raft_consensus.cc:504] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.174147 10100 consensus_queue.cc:237] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.174240 9862 raft_consensus.cc:2454] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:31.174335 10122 leader_election.cc:288] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Requested vote from peers 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129:35171), 3d6a8733c1744c1b86231135574cd4f3 (127.9.82.131:34815)
I20240502 20:45:31.174487 9992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7ab4b4ef882419189c7573251047f12" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:31.174626 9992 raft_consensus.cc:3037] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.174914 9731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5c663f3b944214bdc1cb97f2056c3b" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
I20240502 20:45:31.175020 9731 raft_consensus.cc:3037] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.174978 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5c663f3b944214bdc1cb97f2056c3b" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:31.175098 9993 raft_consensus.cc:3037] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.175423 9729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7505a36f7f6240beba4174043f5c4e39" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
I20240502 20:45:31.175531 9729 raft_consensus.cc:3037] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.175644 9992 raft_consensus.cc:2454] T e7ab4b4ef882419189c7573251047f12 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:31.174484 9990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7505a36f7f6240beba4174043f5c4e39" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:31.175916 9990 raft_consensus.cc:3037] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.175972 9731 raft_consensus.cc:2454] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:31.175972 9993 raft_consensus.cc:2454] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:31.176414 9796 leader_election.cc:302] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:31.176540 9729 raft_consensus.cc:2454] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:31.176582 9796 leader_election.cc:302] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 807a93eca2cf4b17906c4c6febcdea84; no voters:
I20240502 20:45:31.176764 9990 raft_consensus.cc:2454] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:31.176811 10122 raft_consensus.cc:2781] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:31.176887 10122 raft_consensus.cc:686] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [term 1 LEADER]: Becoming Leader. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Running, Role: LEADER
I20240502 20:45:31.176934 9730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7ab4b4ef882419189c7573251047f12" candidate_uuid: "807a93eca2cf4b17906c4c6febcdea84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e"
I20240502 20:45:31.177047 9730 raft_consensus.cc:3037] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.177017 10122 consensus_queue.cc:237] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.177115 10127 raft_consensus.cc:2781] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:31.177189 10127 raft_consensus.cc:686] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 LEADER]: Becoming Leader. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Running, Role: LEADER
I20240502 20:45:31.177217 9796 leader_election.cc:302] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d6a8733c1744c1b86231135574cd4f3, 807a93eca2cf4b17906c4c6febcdea84; no voters:
I20240502 20:45:31.177290 10127 consensus_queue.cc:237] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.177435 10129 raft_consensus.cc:2781] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:31.177492 10129 raft_consensus.cc:686] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 LEADER]: Becoming Leader. State: Replica: 807a93eca2cf4b17906c4c6febcdea84, State: Running, Role: LEADER
I20240502 20:45:31.177597 10129 consensus_queue.cc:237] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.177913 9730 raft_consensus.cc:2454] T e7ab4b4ef882419189c7573251047f12 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 807a93eca2cf4b17906c4c6febcdea84 in term 1.
I20240502 20:45:31.178143 9860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ba36f9bccbd4ca6968e9d2376439673" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "807a93eca2cf4b17906c4c6febcdea84"
I20240502 20:45:31.178046 9587 catalog_manager.cc:5484] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129). New cstate: current_term: 1 leader_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:31.178243 9860 raft_consensus.cc:3037] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.179133 9860 raft_consensus.cc:2454] T 4ba36f9bccbd4ca6968e9d2376439673 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:31.179473 9665 leader_election.cc:302] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 807a93eca2cf4b17906c4c6febcdea84, 95ed5d5c7d9a4441a96ad06d82b3fd7e; no voters:
I20240502 20:45:31.179551 9991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ba36f9bccbd4ca6968e9d2376439673" candidate_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d6a8733c1744c1b86231135574cd4f3"
I20240502 20:45:31.179643 10107 raft_consensus.cc:2781] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:31.179692 9991 raft_consensus.cc:3037] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:31.179777 10107 raft_consensus.cc:686] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 LEADER]: Becoming Leader. State: Replica: 95ed5d5c7d9a4441a96ad06d82b3fd7e, State: Running, Role: LEADER
I20240502 20:45:31.179909 10107 consensus_queue.cc:237] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } }
I20240502 20:45:31.180284 9589 catalog_manager.cc:5484] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "807a93eca2cf4b17906c4c6febcdea84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:31.180665 9991 raft_consensus.cc:2454] T 4ba36f9bccbd4ca6968e9d2376439673 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ed5d5c7d9a4441a96ad06d82b3fd7e in term 1.
I20240502 20:45:31.181123 9589 catalog_manager.cc:5484] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "807a93eca2cf4b17906c4c6febcdea84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:31.181380 9589 catalog_manager.cc:5484] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 807a93eca2cf4b17906c4c6febcdea84 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "807a93eca2cf4b17906c4c6febcdea84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:31.182117 9587 catalog_manager.cc:5484] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ed5d5c7d9a4441a96ad06d82b3fd7e (127.9.82.129). New cstate: current_term: 1 leader_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:31.219388 10069 consensus_queue.cc:1035] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.224294 10069 consensus_queue.cc:1035] T 01dcdd9559db4734ab95f1ec241c58a2 P 3d6a8733c1744c1b86231135574cd4f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.272300 10129 consensus_queue.cc:1035] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.276654 10129 consensus_queue.cc:1035] T 241fc777dd3b42aaadaa191e58104004 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.284583 10107 consensus_queue.cc:1035] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.288851 10107 consensus_queue.cc:1035] T 6c57b12ce15d4e958c6486ebec50d90f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.298264 10062 consensus_queue.cc:1035] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.302093 10100 consensus_queue.cc:1035] T 50c4744713b74e5b921891bbb9e9f51d P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.352871 10100 consensus_queue.cc:1035] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.358196 10118 consensus_queue.cc:1035] T 3744180ae7fe4cbc96a28c2d48aaea36 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.389242 10118 consensus_queue.cc:1035] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 20:45:31.391752 10149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:31.392146 10149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:31.395421 10149 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 20:45:31.397931 10118 consensus_queue.cc:1035] T 037c78e49d4a476d99e41830b69f6909 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_0'
I20240502 20:45:31.428793 10066 consensus_queue.cc:1035] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.432684 10127 consensus_queue.cc:1035] T 4cf4710ff63a4b2e941051de4ddc87e3 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.503186 9991 raft_consensus.cc:1261] T a190505d090d48449d98105ee3cf265f P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Refusing update from remote peer 95ed5d5c7d9a4441a96ad06d82b3fd7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:31.504444 10118 consensus_queue.cc:1035] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.504974 9730 raft_consensus.cc:1261] T 7505a36f7f6240beba4174043f5c4e39 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Refusing update from remote peer 807a93eca2cf4b17906c4c6febcdea84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:31.505311 9729 raft_consensus.cc:1261] T 0f5c663f3b944214bdc1cb97f2056c3b P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Refusing update from remote peer 807a93eca2cf4b17906c4c6febcdea84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:31.506294 10127 consensus_queue.cc:1035] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.506601 10127 consensus_queue.cc:1035] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.509413 9990 raft_consensus.cc:1261] T 0f5c663f3b944214bdc1cb97f2056c3b P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Refusing update from remote peer 807a93eca2cf4b17906c4c6febcdea84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:31.512205 9860 raft_consensus.cc:1261] T a190505d090d48449d98105ee3cf265f P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Refusing update from remote peer 95ed5d5c7d9a4441a96ad06d82b3fd7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:31.516959 9991 raft_consensus.cc:1261] T 7505a36f7f6240beba4174043f5c4e39 P 3d6a8733c1744c1b86231135574cd4f3 [term 1 FOLLOWER]: Refusing update from remote peer 807a93eca2cf4b17906c4c6febcdea84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:31.517474 10127 consensus_queue.cc:1035] T 0f5c663f3b944214bdc1cb97f2056c3b P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.517812 10127 consensus_queue.cc:1035] T 7505a36f7f6240beba4174043f5c4e39 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.519063 10062 consensus_queue.cc:1035] T a190505d090d48449d98105ee3cf265f P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.521189 10062 consensus_queue.cc:1035] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.524874 9859 raft_consensus.cc:1261] T bfc3de218c34422f95da14f9b33bd822 P 807a93eca2cf4b17906c4c6febcdea84 [term 1 FOLLOWER]: Refusing update from remote peer 3d6a8733c1744c1b86231135574cd4f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:31.525379 9728 raft_consensus.cc:1261] T bfc3de218c34422f95da14f9b33bd822 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [term 1 FOLLOWER]: Refusing update from remote peer 3d6a8733c1744c1b86231135574cd4f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:31.526046 10123 consensus_queue.cc:1035] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.526531 10108 consensus_queue.cc:1035] T bfc3de218c34422f95da14f9b33bd822 P 3d6a8733c1744c1b86231135574cd4f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.528280 10148 mvcc.cc:205] Tried to move back new op lower bound from 7023340468229943296 to 7023340466890883072. Current Snapshot: MvccSnapshot[applied={T|T < 7023340468229943296}]
I20240502 20:45:31.538554 10205 mvcc.cc:205] Tried to move back new op lower bound from 7023340468229943296 to 7023340466890883072. Current Snapshot: MvccSnapshot[applied={T|T < 7023340468229943296}]
I20240502 20:45:31.544242 10197 mvcc.cc:205] Tried to move back new op lower bound from 7023340468239441920 to 7023340466902552576. Current Snapshot: MvccSnapshot[applied={T|T < 7023340468239441920}]
I20240502 20:45:31.566924 10211 consensus_queue.cc:1035] T d8f6444b9ad741e786a07b7c5e0ebabc P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.568218 10221 consensus_queue.cc:1035] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.575466 10123 consensus_queue.cc:1035] T 992494c112194a06b01ebe322edc4bbf P 3d6a8733c1744c1b86231135574cd4f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.579361 10107 consensus_queue.cc:1035] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 169.221 ms
time per row: 0.0846103 ms
I20240502 20:45:31.613121 10107 consensus_queue.cc:1035] T 4ba36f9bccbd4ca6968e9d2376439673 P 95ed5d5c7d9a4441a96ad06d82b3fd7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "807a93eca2cf4b17906c4c6febcdea84" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.625643 10128 consensus_queue.cc:1035] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.629892 10127 consensus_queue.cc:1035] T e7ab4b4ef882419189c7573251047f12 P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.657298 10127 consensus_queue.cc:1035] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d6a8733c1744c1b86231135574cd4f3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.661044 10127 consensus_queue.cc:1035] T 88cb5e5e85034b19a5b83da5144de6be P 807a93eca2cf4b17906c4c6febcdea84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ed5d5c7d9a4441a96ad06d82b3fd7e" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 35171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:31.847218 9970 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:31.847445 9831 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:45:31.847833 9711 tablet_service.cc:1429] Tablet server has 7 leaders and 0 scanners
I20240502 20:45:31.955420 9831 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:45:31.955467 9970 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:31.957639 9711 tablet_service.cc:1429] Tablet server has 7 leaders and 0 scanners
I20240502 20:45:32.077324 9831 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:45:32.077440 9970 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:32.079336 9711 tablet_service.cc:1429] Tablet server has 7 leaders and 0 scanners
I20240502 20:45:32.345010 9831 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:45:32.346701 9970 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:32.346729 9711 tablet_service.cc:1429] Tablet server has 7 leaders and 0 scanners
I20240502 20:45:32.462262 9970 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:32.462448 9831 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:45:32.462610 9711 tablet_service.cc:1429] Tablet server has 7 leaders and 0 scanners
I20240502 20:45:32.499761 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 9649
I20240502 20:45:32.507979 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 9780
I20240502 20:45:32.515199 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 9911
I20240502 20:45:32.522344 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 9558
2024-05-02T20:45:32Z chronyd exiting
[ OK ] TableRangeRebalancingTest.Basic (6650 ms)
[----------] 1 test from TableRangeRebalancingTest (6650 ms total)
[----------] 1 test from RebalanceStartSafetyTest
[ RUN ] RebalanceStartSafetyTest.TooManyIgnoredTservers/1
I20240502 20:45:32.555182 9546 test_util.cc:268] Using random seed: -1355994201
I20240502 20:45:32.556134 9546 ts_itest-base.cc:112] Starting cluster with:
I20240502 20:45:32.556177 9546 ts_itest-base.cc:113] --------------
I20240502 20:45:32.556188 9546 ts_itest-base.cc:114] 5 tablet servers
I20240502 20:45:32.556200 9546 ts_itest-base.cc:115] 3 replicas per TS
I20240502 20:45:32.556210 9546 ts_itest-base.cc:116] --------------
2024-05-02T20:45:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T20:45:32Z Disabled control of system clock
I20240502 20:45:32.565992 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:40551
--webserver_interface=127.9.82.190
--webserver_port=0
--builtin_ntp_servers=127.9.82.148:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.82.190:40551
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false with env {}
W20240502 20:45:32.688210 10402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:32.688539 10402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:32.688634 10402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:32.692070 10402 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:32.692186 10402 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 20:45:32.692229 10402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:32.692272 10402 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 20:45:32.692315 10402 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 20:45:32.696472 10402 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.9.82.190:40551
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:40551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.9.82.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.10402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:32.697540 10402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:32.698767 10402 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:32.707401 10408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:32.707966 10407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:32.708709 10410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:32.709443 10402 server_base.cc:1034] running on GCE node
I20240502 20:45:32.710064 10402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:32.711138 10402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:32.712313 10402 hybrid_clock.cc:648] HybridClock initialized: now 1714682732712294 us; error 36 us; skew 500 ppm
I20240502 20:45:32.714566 10402 webserver.cc:460] Webserver started at http://127.9.82.190:36257/ using document root <none> and password file <none>
I20240502 20:45:32.715193 10402 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:32.715260 10402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:32.715452 10402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:32.717330 10402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "78c442c1b6b34b978c883f28fdfa3bcc"
format_stamp: "Formatted at 2024-05-02 20:45:32 on dist-test-slave-2pss"
I20240502 20:45:32.718009 10402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "78c442c1b6b34b978c883f28fdfa3bcc"
format_stamp: "Formatted at 2024-05-02 20:45:32 on dist-test-slave-2pss"
I20240502 20:45:32.722976 10402 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240502 20:45:32.725780 10416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:32.726965 10402 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:32.727136 10402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
uuid: "78c442c1b6b34b978c883f28fdfa3bcc"
format_stamp: "Formatted at 2024-05-02 20:45:32 on dist-test-slave-2pss"
I20240502 20:45:32.727252 10402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:32.747567 10402 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:32.748379 10402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:32.748564 10402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:32.755781 10402 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.190:40551
I20240502 20:45:32.755806 10468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.190:40551 every 8 connection(s)
I20240502 20:45:32.757018 10402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 20:45:32.759930 10469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:32.762881 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 10402
I20240502 20:45:32.763034 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 20:45:32.766350 10469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc: Bootstrap starting.
I20240502 20:45:32.768991 10469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:32.769960 10469 log.cc:824] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:32.772130 10469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc: No bootstrap required, opened a new log
I20240502 20:45:32.774781 10469 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c442c1b6b34b978c883f28fdfa3bcc" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40551 } }
I20240502 20:45:32.775002 10469 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:32.775045 10469 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c442c1b6b34b978c883f28fdfa3bcc, State: Initialized, Role: FOLLOWER
I20240502 20:45:32.775492 10469 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c442c1b6b34b978c883f28fdfa3bcc" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40551 } }
I20240502 20:45:32.775611 10469 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:45:32.775657 10469 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:45:32.775786 10469 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:32.776777 10469 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c442c1b6b34b978c883f28fdfa3bcc" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40551 } }
I20240502 20:45:32.777158 10469 leader_election.cc:302] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78c442c1b6b34b978c883f28fdfa3bcc; no voters:
I20240502 20:45:32.777462 10469 leader_election.cc:288] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:45:32.777645 10474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:32.777851 10474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [term 1 LEADER]: Becoming Leader. State: Replica: 78c442c1b6b34b978c883f28fdfa3bcc, State: Running, Role: LEADER
I20240502 20:45:32.778187 10474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c442c1b6b34b978c883f28fdfa3bcc" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40551 } }
I20240502 20:45:32.778826 10469 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [sys.catalog]: configured and running, proceeding with master startup.
I20240502 20:45:32.780016 10475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78c442c1b6b34b978c883f28fdfa3bcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c442c1b6b34b978c883f28fdfa3bcc" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40551 } } }
I20240502 20:45:32.780186 10475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [sys.catalog]: This master's current role is: LEADER
I20240502 20:45:32.779991 10476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78c442c1b6b34b978c883f28fdfa3bcc. Latest consensus state: current_term: 1 leader_uuid: "78c442c1b6b34b978c883f28fdfa3bcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c442c1b6b34b978c883f28fdfa3bcc" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 40551 } } }
I20240502 20:45:32.780405 10476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc [sys.catalog]: This master's current role is: LEADER
W20240502 20:45:32.784287 10490 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20240502 20:45:32.784375 10490 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20240502 20:45:32.784466 10483 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 20:45:32.785286 10483 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 20:45:32.791179 10483 catalog_manager.cc:1347] Generated new cluster ID: 45e6165c2077465680b2d79c63a406ed
I20240502 20:45:32.791287 10483 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 20:45:32.805056 10483 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 20:45:32.806082 10483 catalog_manager.cc:1504] Loading token signing keys...
I20240502 20:45:32.812601 10483 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 78c442c1b6b34b978c883f28fdfa3bcc: Generated new TSK 0
I20240502 20:45:32.813514 10483 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 20:45:32.824724 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.129:0
--local_ip_for_outbound_sockets=127.9.82.129
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--builtin_ntp_servers=127.9.82.148:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:45:32.939070 10493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:32.939340 10493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:32.939388 10493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:32.942656 10493 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:32.942741 10493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:32.942826 10493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.129
I20240502 20:45:32.946730 10493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--never_fsync=true
--heap_profile_path=/tmp/kudu.10493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.129
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:32.947801 10493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:32.949048 10493 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:32.958175 10498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:32.958837 10501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:32.959559 10499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:32.960250 10493 server_base.cc:1034] running on GCE node
I20240502 20:45:32.960714 10493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:32.961388 10493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:32.962620 10493 hybrid_clock.cc:648] HybridClock initialized: now 1714682732962591 us; error 45 us; skew 500 ppm
I20240502 20:45:32.964908 10493 webserver.cc:460] Webserver started at http://127.9.82.129:42627/ using document root <none> and password file <none>
I20240502 20:45:32.965530 10493 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:32.965600 10493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:32.965808 10493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:32.967653 10493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "7e41c1ad5bbc460c80a1a2ea654acf67"
format_stamp: "Formatted at 2024-05-02 20:45:32 on dist-test-slave-2pss"
I20240502 20:45:32.968250 10493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "7e41c1ad5bbc460c80a1a2ea654acf67"
format_stamp: "Formatted at 2024-05-02 20:45:32 on dist-test-slave-2pss"
I20240502 20:45:32.972330 10493 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20240502 20:45:32.975237 10507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:32.976660 10493 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:45:32.976811 10493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "7e41c1ad5bbc460c80a1a2ea654acf67"
format_stamp: "Formatted at 2024-05-02 20:45:32 on dist-test-slave-2pss"
I20240502 20:45:32.976945 10493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:32.996251 10493 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:32.996950 10493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:32.997133 10493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:32.997714 10493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:32.998647 10493 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:32.998698 10493 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:32.998762 10493 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:32.998792 10493 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.007835 10493 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.129:44513
I20240502 20:45:33.007869 10622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.129:44513 every 8 connection(s)
I20240502 20:45:33.008836 10493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 20:45:33.012243 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 10493
I20240502 20:45:33.012384 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 20:45:33.014784 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.130:0
--local_ip_for_outbound_sockets=127.9.82.130
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--builtin_ntp_servers=127.9.82.148:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:33.018935 10623 heartbeater.cc:347] Connected to a master server at 127.9.82.190:40551
I20240502 20:45:33.019176 10623 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:33.019776 10623 heartbeater.cc:511] Master 127.9.82.190:40551 requested a full tablet report, sending...
I20240502 20:45:33.021389 10433 ts_manager.cc:194] Registered new tserver with Master: 7e41c1ad5bbc460c80a1a2ea654acf67 (127.9.82.129:44513)
I20240502 20:45:33.022594 10433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.129:39869
W20240502 20:45:33.127826 10626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:33.128118 10626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:33.128188 10626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:33.131667 10626 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:33.131798 10626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:33.131906 10626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.130
I20240502 20:45:33.135942 10626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--never_fsync=true
--heap_profile_path=/tmp/kudu.10626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.130
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:33.137035 10626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:33.138316 10626 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:33.148651 10632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:33.149195 10631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:33.149936 10634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:33.150652 10626 server_base.cc:1034] running on GCE node
I20240502 20:45:33.151099 10626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:33.151755 10626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:33.152945 10626 hybrid_clock.cc:648] HybridClock initialized: now 1714682733152926 us; error 35 us; skew 500 ppm
I20240502 20:45:33.155084 10626 webserver.cc:460] Webserver started at http://127.9.82.130:46753/ using document root <none> and password file <none>
I20240502 20:45:33.155642 10626 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:33.155712 10626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:33.155929 10626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:33.157668 10626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "85da0495544d48989705604694c4100a"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.158143 10626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "85da0495544d48989705604694c4100a"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.161598 10626 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20240502 20:45:33.163920 10641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.164960 10626 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 20:45:33.165067 10626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "85da0495544d48989705604694c4100a"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.165169 10626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:33.188633 10626 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:33.189316 10626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:33.189504 10626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:33.190089 10626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:33.191038 10626 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:33.191088 10626 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.191150 10626 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:33.191183 10626 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.200327 10754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.130:40747 every 8 connection(s)
I20240502 20:45:33.200302 10626 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.130:40747
I20240502 20:45:33.201391 10626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 20:45:33.202234 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 10626
I20240502 20:45:33.202356 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 20:45:33.204840 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.131:0
--local_ip_for_outbound_sockets=127.9.82.131
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--builtin_ntp_servers=127.9.82.148:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:33.212273 10755 heartbeater.cc:347] Connected to a master server at 127.9.82.190:40551
I20240502 20:45:33.212551 10755 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:33.213296 10755 heartbeater.cc:511] Master 127.9.82.190:40551 requested a full tablet report, sending...
I20240502 20:45:33.214601 10433 ts_manager.cc:194] Registered new tserver with Master: 85da0495544d48989705604694c4100a (127.9.82.130:40747)
I20240502 20:45:33.215456 10433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.130:51599
W20240502 20:45:33.321699 10758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:33.321971 10758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:33.322019 10758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:33.325215 10758 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:33.325302 10758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:33.325373 10758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.131
I20240502 20:45:33.329231 10758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--never_fsync=true
--heap_profile_path=/tmp/kudu.10758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.131
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:33.330310 10758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:33.331565 10758 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:33.340988 10766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:33.341517 10763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:33.342034 10764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:33.342835 10758 server_base.cc:1034] running on GCE node
I20240502 20:45:33.343348 10758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:33.344034 10758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:33.345227 10758 hybrid_clock.cc:648] HybridClock initialized: now 1714682733345200 us; error 42 us; skew 500 ppm
I20240502 20:45:33.347671 10758 webserver.cc:460] Webserver started at http://127.9.82.131:39203/ using document root <none> and password file <none>
I20240502 20:45:33.348368 10758 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:33.348440 10758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:33.348635 10758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:33.350517 10758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "e0fd91424b5d4da592728cdc56c3c690"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.351058 10758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "e0fd91424b5d4da592728cdc56c3c690"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.354728 10758 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20240502 20:45:33.357328 10772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.358532 10758 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:33.358664 10758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "e0fd91424b5d4da592728cdc56c3c690"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.358776 10758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:33.386296 10758 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:33.387002 10758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:33.387188 10758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:33.387833 10758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:33.388810 10758 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:33.388864 10758 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.388928 10758 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:33.388960 10758 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.397689 10758 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.131:35385
I20240502 20:45:33.397771 10886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.131:35385 every 8 connection(s)
I20240502 20:45:33.398712 10758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 20:45:33.402659 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 10758
I20240502 20:45:33.402765 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 20:45:33.405022 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.132:0
--local_ip_for_outbound_sockets=127.9.82.132
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--builtin_ntp_servers=127.9.82.148:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:33.408298 10887 heartbeater.cc:347] Connected to a master server at 127.9.82.190:40551
I20240502 20:45:33.408576 10887 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:33.409199 10887 heartbeater.cc:511] Master 127.9.82.190:40551 requested a full tablet report, sending...
I20240502 20:45:33.410326 10433 ts_manager.cc:194] Registered new tserver with Master: e0fd91424b5d4da592728cdc56c3c690 (127.9.82.131:35385)
I20240502 20:45:33.410929 10433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.131:52877
W20240502 20:45:33.524132 10890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:33.524387 10890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:33.524435 10890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:33.527850 10890 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:33.527936 10890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:33.528024 10890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.132
I20240502 20:45:33.531925 10890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--never_fsync=true
--heap_profile_path=/tmp/kudu.10890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.132
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:33.532897 10890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:33.534060 10890 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:33.543185 10898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:33.543812 10895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:33.544338 10896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:33.545189 10890 server_base.cc:1034] running on GCE node
I20240502 20:45:33.545670 10890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:33.546310 10890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:33.547493 10890 hybrid_clock.cc:648] HybridClock initialized: now 1714682733547469 us; error 43 us; skew 500 ppm
I20240502 20:45:33.549721 10890 webserver.cc:460] Webserver started at http://127.9.82.132:38381/ using document root <none> and password file <none>
I20240502 20:45:33.550319 10890 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:33.550386 10890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:33.550570 10890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:33.552386 10890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "f072031300d4485a82f0706f95a0cf63"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.552886 10890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "f072031300d4485a82f0706f95a0cf63"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.556640 10890 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240502 20:45:33.559041 10904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.560338 10890 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:45:33.560474 10890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "f072031300d4485a82f0706f95a0cf63"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.560575 10890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:33.596563 10890 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:33.597242 10890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:33.597420 10890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:33.598003 10890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:33.598942 10890 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:33.598992 10890 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.599058 10890 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:33.599084 10890 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.608276 10890 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.132:45757
I20240502 20:45:33.608350 11018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.132:45757 every 8 connection(s)
I20240502 20:45:33.609292 10890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 20:45:33.612727 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 10890
I20240502 20:45:33.612835 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 20:45:33.615180 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.133:0
--local_ip_for_outbound_sockets=127.9.82.133
--webserver_interface=127.9.82.133
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--builtin_ntp_servers=127.9.82.148:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:33.619153 11019 heartbeater.cc:347] Connected to a master server at 127.9.82.190:40551
I20240502 20:45:33.619398 11019 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:33.620034 11019 heartbeater.cc:511] Master 127.9.82.190:40551 requested a full tablet report, sending...
I20240502 20:45:33.621227 10433 ts_manager.cc:194] Registered new tserver with Master: f072031300d4485a82f0706f95a0cf63 (127.9.82.132:45757)
I20240502 20:45:33.622092 10433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.132:39745
W20240502 20:45:33.732436 11022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:33.732671 11022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:33.732717 11022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:33.735863 11022 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:33.735942 11022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:33.736016 11022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.133
I20240502 20:45:33.739903 11022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.9.82.133
--webserver_port=0
--tserver_master_addrs=127.9.82.190:40551
--never_fsync=true
--heap_profile_path=/tmp/kudu.11022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.133
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:33.740831 11022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:33.741920 11022 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:33.750891 11030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:33.751250 11028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:33.751905 11027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:33.752732 11022 server_base.cc:1034] running on GCE node
I20240502 20:45:33.753196 11022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:33.753856 11022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:33.755023 11022 hybrid_clock.cc:648] HybridClock initialized: now 1714682733755010 us; error 38 us; skew 500 ppm
I20240502 20:45:33.757381 11022 webserver.cc:460] Webserver started at http://127.9.82.133:39921/ using document root <none> and password file <none>
I20240502 20:45:33.757974 11022 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:33.758042 11022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:33.758229 11022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:33.760116 11022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "b224274da1dc497dbb6091ef52accfe5"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.760610 11022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "b224274da1dc497dbb6091ef52accfe5"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.764487 11022 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20240502 20:45:33.766904 11036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.768055 11022 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:45:33.768196 11022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "b224274da1dc497dbb6091ef52accfe5"
format_stamp: "Formatted at 2024-05-02 20:45:33 on dist-test-slave-2pss"
I20240502 20:45:33.768292 11022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:33.787766 11022 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:33.788458 11022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:33.788630 11022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:33.789181 11022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:33.790098 11022 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:33.790148 11022 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.790205 11022 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:33.790237 11022 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:33.799127 11022 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.133:37525
I20240502 20:45:33.799158 11150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.133:37525 every 8 connection(s)
I20240502 20:45:33.800200 11022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 20:45:33.803499 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 11022
I20240502 20:45:33.803609 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20240502 20:45:33.809373 11151 heartbeater.cc:347] Connected to a master server at 127.9.82.190:40551
I20240502 20:45:33.809587 11151 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:33.810092 11151 heartbeater.cc:511] Master 127.9.82.190:40551 requested a full tablet report, sending...
I20240502 20:45:33.811054 10433 ts_manager.cc:194] Registered new tserver with Master: b224274da1dc497dbb6091ef52accfe5 (127.9.82.133:37525)
I20240502 20:45:33.811612 10433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.133:36963
I20240502 20:45:33.818086 9546 external_mini_cluster.cc:930] 5 TS(s) registered with all masters
I20240502 20:45:33.828626 10433 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52480:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20240502 20:45:33.848111 11084 tablet_service.cc:1467] Processing CreateTablet for tablet 55984fd86b7845eab4bcc26c4dbb4005 (DEFAULT_TABLE table=TestTable [id=b658987027924a59a409752a0f6ee50f]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:33.848114 10689 tablet_service.cc:1467] Processing CreateTablet for tablet 55984fd86b7845eab4bcc26c4dbb4005 (DEFAULT_TABLE table=TestTable [id=b658987027924a59a409752a0f6ee50f]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:33.848115 10557 tablet_service.cc:1467] Processing CreateTablet for tablet 55984fd86b7845eab4bcc26c4dbb4005 (DEFAULT_TABLE table=TestTable [id=b658987027924a59a409752a0f6ee50f]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:33.849123 11084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55984fd86b7845eab4bcc26c4dbb4005. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:33.849126 10689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55984fd86b7845eab4bcc26c4dbb4005. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:33.849126 10557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55984fd86b7845eab4bcc26c4dbb4005. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:33.854593 11169 tablet_bootstrap.cc:492] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5: Bootstrap starting.
I20240502 20:45:33.855923 11170 tablet_bootstrap.cc:492] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a: Bootstrap starting.
I20240502 20:45:33.855926 11171 tablet_bootstrap.cc:492] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67: Bootstrap starting.
I20240502 20:45:33.857120 11169 tablet_bootstrap.cc:654] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:33.857993 11169 log.cc:824] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:33.858172 11170 tablet_bootstrap.cc:654] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:33.858417 11171 tablet_bootstrap.cc:654] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:33.859019 11170 log.cc:824] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:33.859076 11171 log.cc:824] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:33.859848 11169 tablet_bootstrap.cc:492] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5: No bootstrap required, opened a new log
I20240502 20:45:33.860157 11169 ts_tablet_manager.cc:1367] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240502 20:45:33.861004 11171 tablet_bootstrap.cc:492] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67: No bootstrap required, opened a new log
I20240502 20:45:33.861004 11170 tablet_bootstrap.cc:492] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a: No bootstrap required, opened a new log
I20240502 20:45:33.861186 11170 ts_tablet_manager.cc:1367] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 20:45:33.861186 11171 ts_tablet_manager.cc:1367] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240502 20:45:33.863762 11169 raft_consensus.cc:348] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } }
I20240502 20:45:33.863979 11169 raft_consensus.cc:374] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:33.864055 11169 raft_consensus.cc:729] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b224274da1dc497dbb6091ef52accfe5, State: Initialized, Role: FOLLOWER
I20240502 20:45:33.864549 11169 consensus_queue.cc:260] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } }
I20240502 20:45:33.865310 11151 heartbeater.cc:503] Master 127.9.82.190:40551 was elected leader, sending a full tablet report...
I20240502 20:45:33.865233 11170 raft_consensus.cc:348] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } }
I20240502 20:45:33.865455 11170 raft_consensus.cc:374] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:33.865353 11171 raft_consensus.cc:348] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } }
I20240502 20:45:33.865504 11170 raft_consensus.cc:729] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85da0495544d48989705604694c4100a, State: Initialized, Role: FOLLOWER
I20240502 20:45:33.865558 11171 raft_consensus.cc:374] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:33.865572 11169 ts_tablet_manager.cc:1398] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 20:45:33.865607 11171 raft_consensus.cc:729] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e41c1ad5bbc460c80a1a2ea654acf67, State: Initialized, Role: FOLLOWER
I20240502 20:45:33.865994 11171 consensus_queue.cc:260] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } }
I20240502 20:45:33.865994 11170 consensus_queue.cc:260] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } }
I20240502 20:45:33.866927 11170 ts_tablet_manager.cc:1398] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20240502 20:45:33.866926 11171 ts_tablet_manager.cc:1398] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20240502 20:45:33.867269 10623 heartbeater.cc:503] Master 127.9.82.190:40551 was elected leader, sending a full tablet report...
I20240502 20:45:33.867288 10755 heartbeater.cc:503] Master 127.9.82.190:40551 was elected leader, sending a full tablet report...
W20240502 20:45:33.952831 10756 tablet.cc:2369] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 20:45:34.010531 10624 tablet.cc:2369] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 20:45:34.051172 11152 tablet.cc:2369] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:45:34.218284 11177 raft_consensus.cc:482] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:34.218547 11177 raft_consensus.cc:504] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } }
I20240502 20:45:34.220362 11177 leader_election.cc:288] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b224274da1dc497dbb6091ef52accfe5 (127.9.82.133:37525), 7e41c1ad5bbc460c80a1a2ea654acf67 (127.9.82.129:44513)
I20240502 20:45:34.223807 11104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55984fd86b7845eab4bcc26c4dbb4005" candidate_uuid: "85da0495544d48989705604694c4100a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b224274da1dc497dbb6091ef52accfe5" is_pre_election: true
I20240502 20:45:34.224038 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55984fd86b7845eab4bcc26c4dbb4005" candidate_uuid: "85da0495544d48989705604694c4100a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" is_pre_election: true
I20240502 20:45:34.224169 11104 raft_consensus.cc:2454] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85da0495544d48989705604694c4100a in term 0.
I20240502 20:45:34.224289 10577 raft_consensus.cc:2454] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85da0495544d48989705604694c4100a in term 0.
I20240502 20:45:34.224699 10645 leader_election.cc:302] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85da0495544d48989705604694c4100a, b224274da1dc497dbb6091ef52accfe5; no voters:
I20240502 20:45:34.225011 11177 raft_consensus.cc:2781] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:34.225100 11177 raft_consensus.cc:482] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:34.225152 11177 raft_consensus.cc:3037] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:34.226079 11177 raft_consensus.cc:504] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } }
I20240502 20:45:34.226449 11177 leader_election.cc:288] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [CANDIDATE]: Term 1 election: Requested vote from peers b224274da1dc497dbb6091ef52accfe5 (127.9.82.133:37525), 7e41c1ad5bbc460c80a1a2ea654acf67 (127.9.82.129:44513)
I20240502 20:45:34.226821 11104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55984fd86b7845eab4bcc26c4dbb4005" candidate_uuid: "85da0495544d48989705604694c4100a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b224274da1dc497dbb6091ef52accfe5"
I20240502 20:45:34.226835 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55984fd86b7845eab4bcc26c4dbb4005" candidate_uuid: "85da0495544d48989705604694c4100a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67"
I20240502 20:45:34.226941 10577 raft_consensus.cc:3037] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:34.227018 11104 raft_consensus.cc:3037] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:34.227852 10577 raft_consensus.cc:2454] T 55984fd86b7845eab4bcc26c4dbb4005 P 7e41c1ad5bbc460c80a1a2ea654acf67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85da0495544d48989705604694c4100a in term 1.
I20240502 20:45:34.227977 11104 raft_consensus.cc:2454] T 55984fd86b7845eab4bcc26c4dbb4005 P b224274da1dc497dbb6091ef52accfe5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85da0495544d48989705604694c4100a in term 1.
I20240502 20:45:34.228220 10644 leader_election.cc:302] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e41c1ad5bbc460c80a1a2ea654acf67, 85da0495544d48989705604694c4100a; no voters:
I20240502 20:45:34.228487 11177 raft_consensus.cc:2781] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:34.228739 11177 raft_consensus.cc:686] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [term 1 LEADER]: Becoming Leader. State: Replica: 85da0495544d48989705604694c4100a, State: Running, Role: LEADER
I20240502 20:45:34.229090 11177 consensus_queue.cc:237] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } }
I20240502 20:45:34.232503 10433 catalog_manager.cc:5484] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a reported cstate change: term changed from 0 to 1, leader changed from <none> to 85da0495544d48989705604694c4100a (127.9.82.130). New cstate: current_term: 1 leader_uuid: "85da0495544d48989705604694c4100a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85da0495544d48989705604694c4100a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:34.297885 9546 external_mini_cluster.cc:930] 5 TS(s) registered with all masters
I20240502 20:45:34.299767 9546 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 7e41c1ad5bbc460c80a1a2ea654acf67 to finish bootstrapping
I20240502 20:45:34.305904 9546 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 85da0495544d48989705604694c4100a to finish bootstrapping
I20240502 20:45:34.311133 9546 ts_itest-base.cc:233] Waiting for 0 tablets on tserver e0fd91424b5d4da592728cdc56c3c690 to finish bootstrapping
I20240502 20:45:34.317298 9546 ts_itest-base.cc:233] Waiting for 0 tablets on tserver f072031300d4485a82f0706f95a0cf63 to finish bootstrapping
I20240502 20:45:34.323284 9546 ts_itest-base.cc:233] Waiting for 1 tablets on tserver b224274da1dc497dbb6091ef52accfe5 to finish bootstrapping
I20240502 20:45:34.413059 10887 heartbeater.cc:503] Master 127.9.82.190:40551 was elected leader, sending a full tablet report...
I20240502 20:45:34.526703 10820 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.527175 11084 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.527873 10689 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:45:34.533965 10557 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.536481 10953 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.624365 11019 heartbeater.cc:503] Master 127.9.82.190:40551 was elected leader, sending a full tablet report...
I20240502 20:45:34.633038 10689 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:45:34.633126 11084 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.635579 10820 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.636363 10953 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.640918 10557 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.703927 11177 consensus_queue.cc:1035] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e41c1ad5bbc460c80a1a2ea654acf67" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 44513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:34.710934 11180 consensus_queue.cc:1035] T 55984fd86b7845eab4bcc26c4dbb4005 P 85da0495544d48989705604694c4100a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b224274da1dc497dbb6091ef52accfe5" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:34.748761 10689 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:45:34.749183 10557 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.749608 11084 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.750650 10820 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.752144 10953 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.996794 11084 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.997035 10820 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.997293 10557 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:34.997880 10953 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:35.004812 10689 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:45:35.104174 11084 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:35.104879 10820 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:35.105111 10557 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:35.106166 10689 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:45:35.106428 10953 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:35.209482 10689 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:45:35.209996 11084 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:35.213918 10820 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:35.218959 10557 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:35.220232 10953 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:35.253324 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 10493
I20240502 20:45:35.260105 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 10626
I20240502 20:45:35.266571 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 10758
I20240502 20:45:35.272910 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 10890
I20240502 20:45:35.279141 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 11022
I20240502 20:45:35.285421 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 10402
2024-05-02T20:45:35Z chronyd exiting
[ OK ] RebalanceStartSafetyTest.TooManyIgnoredTservers/1 (2754 ms)
[----------] 1 test from RebalanceStartSafetyTest (2754 ms total)
[----------] 1 test from RebalanceParamTest
[ RUN ] RebalanceParamTest.Rebalance/7
I20240502 20:45:35.310113 9546 test_util.cc:268] Using random seed: -1353239270
I20240502 20:45:35.310962 9546 ts_itest-base.cc:112] Starting cluster with:
I20240502 20:45:35.311007 9546 ts_itest-base.cc:113] --------------
I20240502 20:45:35.311024 9546 ts_itest-base.cc:114] 7 tablet servers
I20240502 20:45:35.311040 9546 ts_itest-base.cc:115] 5 replicas per TS
I20240502 20:45:35.311055 9546 ts_itest-base.cc:116] --------------
2024-05-02T20:45:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T20:45:35Z Disabled control of system clock
I20240502 20:45:35.320667 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:43461
--webserver_interface=127.9.82.190
--webserver_port=0
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.82.190:43461
--allow_unsafe_replication_factor
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--tserver_unresponsive_timeout_ms=3000 with env {}
W20240502 20:45:35.438627 11395 flags.cc:425] Enabled unsafe flag: --allow_unsafe_replication_factor=true
W20240502 20:45:35.438928 11395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:35.438979 11395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:35.439056 11395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:35.442359 11395 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:35.442466 11395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 20:45:35.442510 11395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:35.442552 11395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 20:45:35.442593 11395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 20:45:35.446621 11395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--allow_unsafe_replication_factor=true
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.9.82.190:43461
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:43461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.9.82.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.11395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:35.447705 11395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:35.448952 11395 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:35.457382 11401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:35.458040 11403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:35.458660 11400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:35.459548 11395 server_base.cc:1034] running on GCE node
I20240502 20:45:35.460228 11395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:35.461282 11395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:35.462457 11395 hybrid_clock.cc:648] HybridClock initialized: now 1714682735462434 us; error 42 us; skew 500 ppm
I20240502 20:45:35.464708 11395 webserver.cc:460] Webserver started at http://127.9.82.190:40709/ using document root <none> and password file <none>
I20240502 20:45:35.465431 11395 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:35.465517 11395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:35.465730 11395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:35.467595 11395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "5386a2faaac64ec7b5ca5c0b90daa78b"
format_stamp: "Formatted at 2024-05-02 20:45:35 on dist-test-slave-2pss"
I20240502 20:45:35.468189 11395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "5386a2faaac64ec7b5ca5c0b90daa78b"
format_stamp: "Formatted at 2024-05-02 20:45:35 on dist-test-slave-2pss"
I20240502 20:45:35.471868 11395 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 20:45:35.474432 11409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:35.475615 11395 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:35.475808 11395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
uuid: "5386a2faaac64ec7b5ca5c0b90daa78b"
format_stamp: "Formatted at 2024-05-02 20:45:35 on dist-test-slave-2pss"
I20240502 20:45:35.475924 11395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:35.500249 11395 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:35.500985 11395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:35.501165 11395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:35.507987 11395 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.190:43461
I20240502 20:45:35.508001 11462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.190:43461 every 8 connection(s)
I20240502 20:45:35.509044 11395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 20:45:35.511883 11463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:35.517218 11463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b: Bootstrap starting.
I20240502 20:45:35.517828 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 11395
I20240502 20:45:35.517969 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 20:45:35.519963 11463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:35.520717 11463 log.cc:824] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:35.522434 11463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b: No bootstrap required, opened a new log
I20240502 20:45:35.525342 11463 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386a2faaac64ec7b5ca5c0b90daa78b" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 43461 } }
I20240502 20:45:35.525563 11463 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:35.525633 11463 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5386a2faaac64ec7b5ca5c0b90daa78b, State: Initialized, Role: FOLLOWER
I20240502 20:45:35.526156 11463 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386a2faaac64ec7b5ca5c0b90daa78b" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 43461 } }
I20240502 20:45:35.526315 11463 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:45:35.526377 11463 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:45:35.526489 11463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:35.527357 11463 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386a2faaac64ec7b5ca5c0b90daa78b" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 43461 } }
I20240502 20:45:35.527693 11463 leader_election.cc:302] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5386a2faaac64ec7b5ca5c0b90daa78b; no voters:
I20240502 20:45:35.528081 11463 leader_election.cc:288] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:45:35.528472 11468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:35.528698 11468 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [term 1 LEADER]: Becoming Leader. State: Replica: 5386a2faaac64ec7b5ca5c0b90daa78b, State: Running, Role: LEADER
I20240502 20:45:35.529021 11468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386a2faaac64ec7b5ca5c0b90daa78b" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 43461 } }
I20240502 20:45:35.529290 11463 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [sys.catalog]: configured and running, proceeding with master startup.
I20240502 20:45:35.530649 11470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5386a2faaac64ec7b5ca5c0b90daa78b. Latest consensus state: current_term: 1 leader_uuid: "5386a2faaac64ec7b5ca5c0b90daa78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386a2faaac64ec7b5ca5c0b90daa78b" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 43461 } } }
I20240502 20:45:35.530649 11469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5386a2faaac64ec7b5ca5c0b90daa78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386a2faaac64ec7b5ca5c0b90daa78b" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 43461 } } }
I20240502 20:45:35.530809 11470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [sys.catalog]: This master's current role is: LEADER
I20240502 20:45:35.530809 11469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b [sys.catalog]: This master's current role is: LEADER
I20240502 20:45:35.531297 11482 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 20:45:35.534638 11482 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 20:45:35.540306 11482 catalog_manager.cc:1347] Generated new cluster ID: 8d7f5de628694757bc11733b1773e4d0
I20240502 20:45:35.540409 11482 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 20:45:35.570991 11482 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 20:45:35.572376 11482 catalog_manager.cc:1504] Loading token signing keys...
I20240502 20:45:35.580080 11482 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 5386a2faaac64ec7b5ca5c0b90daa78b: Generated new TSK 0
I20240502 20:45:35.580912 11482 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 20:45:35.585031 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.129:0
--local_ip_for_outbound_sockets=127.9.82.129
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:45:35.704710 11487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:35.704977 11487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:35.705024 11487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:35.708321 11487 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:35.708416 11487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:35.708499 11487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.129
I20240502 20:45:35.712800 11487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--never_fsync=true
--heap_profile_path=/tmp/kudu.11487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.129
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:35.713876 11487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:35.715129 11487 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:35.724926 11495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:35.725356 11492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:35.726004 11493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:35.726728 11487 server_base.cc:1034] running on GCE node
I20240502 20:45:35.727216 11487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:35.727936 11487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:35.729108 11487 hybrid_clock.cc:648] HybridClock initialized: now 1714682735729068 us; error 53 us; skew 500 ppm
I20240502 20:45:35.732012 11487 webserver.cc:460] Webserver started at http://127.9.82.129:39533/ using document root <none> and password file <none>
I20240502 20:45:35.732666 11487 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:35.732730 11487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:35.732908 11487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:35.734675 11487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "5521e131639043f8b116f9c71cf4bfee"
format_stamp: "Formatted at 2024-05-02 20:45:35 on dist-test-slave-2pss"
I20240502 20:45:35.735188 11487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "5521e131639043f8b116f9c71cf4bfee"
format_stamp: "Formatted at 2024-05-02 20:45:35 on dist-test-slave-2pss"
I20240502 20:45:35.738862 11487 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20240502 20:45:35.741447 11501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:35.742743 11487 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:35.742895 11487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "5521e131639043f8b116f9c71cf4bfee"
format_stamp: "Formatted at 2024-05-02 20:45:35 on dist-test-slave-2pss"
I20240502 20:45:35.743027 11487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:35.756521 11487 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:35.757248 11487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:35.757426 11487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:35.758010 11487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:35.758963 11487 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:35.759024 11487 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:35.759094 11487 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:35.759124 11487 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:35.768374 11487 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.129:36161
I20240502 20:45:35.768390 11615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.129:36161 every 8 connection(s)
I20240502 20:45:35.769429 11487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 20:45:35.772409 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 11487
I20240502 20:45:35.772540 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 20:45:35.774808 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.130:0
--local_ip_for_outbound_sockets=127.9.82.130
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:35.779857 11616 heartbeater.cc:347] Connected to a master server at 127.9.82.190:43461
I20240502 20:45:35.780140 11616 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:35.780826 11616 heartbeater.cc:511] Master 127.9.82.190:43461 requested a full tablet report, sending...
I20240502 20:45:35.782766 11426 ts_manager.cc:194] Registered new tserver with Master: 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161)
I20240502 20:45:35.784762 11426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.129:60073
W20240502 20:45:35.896039 11619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:35.896287 11619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:35.896333 11619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:35.899458 11619 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:35.899541 11619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:35.899613 11619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.130
I20240502 20:45:35.903465 11619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--never_fsync=true
--heap_profile_path=/tmp/kudu.11619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.130
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:35.904498 11619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:35.905689 11619 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:35.914978 11625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:35.915580 11624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:35.916196 11627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:35.917025 11619 server_base.cc:1034] running on GCE node
I20240502 20:45:35.917485 11619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:35.918129 11619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:35.919306 11619 hybrid_clock.cc:648] HybridClock initialized: now 1714682735919284 us; error 38 us; skew 500 ppm
I20240502 20:45:35.921761 11619 webserver.cc:460] Webserver started at http://127.9.82.130:35803/ using document root <none> and password file <none>
I20240502 20:45:35.922411 11619 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:35.922485 11619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:35.922685 11619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:35.924613 11619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "8096a2fe270b492baa3178ad9d2976e7"
format_stamp: "Formatted at 2024-05-02 20:45:35 on dist-test-slave-2pss"
I20240502 20:45:35.925151 11619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "8096a2fe270b492baa3178ad9d2976e7"
format_stamp: "Formatted at 2024-05-02 20:45:35 on dist-test-slave-2pss"
I20240502 20:45:35.929029 11619 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20240502 20:45:35.931859 11633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:35.933142 11619 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20240502 20:45:35.933290 11619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "8096a2fe270b492baa3178ad9d2976e7"
format_stamp: "Formatted at 2024-05-02 20:45:35 on dist-test-slave-2pss"
I20240502 20:45:35.933425 11619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:35.950452 11619 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:35.951249 11619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:35.951440 11619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:35.952157 11619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:35.953253 11619 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:35.953310 11619 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:35.953354 11619 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:35.953411 11619 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:35.963346 11619 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.130:43991
I20240502 20:45:35.963410 11746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.130:43991 every 8 connection(s)
I20240502 20:45:35.964465 11619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 20:45:35.972740 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 11619
I20240502 20:45:35.972872 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 20:45:35.975502 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.131:0
--local_ip_for_outbound_sockets=127.9.82.131
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:35.975622 11747 heartbeater.cc:347] Connected to a master server at 127.9.82.190:43461
I20240502 20:45:35.975953 11747 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:35.976606 11747 heartbeater.cc:511] Master 127.9.82.190:43461 requested a full tablet report, sending...
I20240502 20:45:35.977792 11426 ts_manager.cc:194] Registered new tserver with Master: 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991)
I20240502 20:45:35.978411 11426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.130:57857
W20240502 20:45:36.093029 11750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:36.093292 11750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:36.093340 11750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:36.096688 11750 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:36.096781 11750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:36.096861 11750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.131
I20240502 20:45:36.100939 11750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--never_fsync=true
--heap_profile_path=/tmp/kudu.11750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.131
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:36.101997 11750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:36.103209 11750 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:36.112375 11756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:36.112978 11758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:36.113675 11755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:36.114437 11750 server_base.cc:1034] running on GCE node
I20240502 20:45:36.114926 11750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:36.115581 11750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:36.116760 11750 hybrid_clock.cc:648] HybridClock initialized: now 1714682736116736 us; error 65 us; skew 500 ppm
I20240502 20:45:36.118919 11750 webserver.cc:460] Webserver started at http://127.9.82.131:34705/ using document root <none> and password file <none>
I20240502 20:45:36.119524 11750 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:36.119596 11750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:36.119885 11750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:36.121769 11750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "07fe14e7347a4682bd8f6026ad776da3"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.122351 11750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "07fe14e7347a4682bd8f6026ad776da3"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.126092 11750 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 20:45:36.128682 11764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.130085 11750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:45:36.130236 11750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "07fe14e7347a4682bd8f6026ad776da3"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.130345 11750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:36.157608 11750 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:36.158416 11750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:36.158619 11750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:36.159250 11750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:36.160322 11750 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:36.160375 11750 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.160439 11750 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:36.160471 11750 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.169355 11750 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.131:42315
I20240502 20:45:36.169384 11877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.131:42315 every 8 connection(s)
I20240502 20:45:36.170354 11750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 20:45:36.173497 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 11750
I20240502 20:45:36.173612 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 20:45:36.176126 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.132:0
--local_ip_for_outbound_sockets=127.9.82.132
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:36.180843 11878 heartbeater.cc:347] Connected to a master server at 127.9.82.190:43461
I20240502 20:45:36.181100 11878 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:36.181720 11878 heartbeater.cc:511] Master 127.9.82.190:43461 requested a full tablet report, sending...
I20240502 20:45:36.182884 11426 ts_manager.cc:194] Registered new tserver with Master: 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:36.183470 11426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.131:47343
W20240502 20:45:36.289453 11881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:36.289712 11881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:36.289790 11881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:36.292985 11881 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:36.293071 11881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:36.293179 11881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.132
I20240502 20:45:36.297010 11881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--never_fsync=true
--heap_profile_path=/tmp/kudu.11881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.132
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:36.298030 11881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:36.299214 11881 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:36.308009 11886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:36.308423 11889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:36.309264 11881 server_base.cc:1034] running on GCE node
W20240502 20:45:36.309834 11887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:36.310310 11881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:36.310986 11881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:36.312193 11881 hybrid_clock.cc:648] HybridClock initialized: now 1714682736312156 us; error 51 us; skew 500 ppm
I20240502 20:45:36.314407 11881 webserver.cc:460] Webserver started at http://127.9.82.132:34271/ using document root <none> and password file <none>
I20240502 20:45:36.314996 11881 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:36.315057 11881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:36.315256 11881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:36.317034 11881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "6529b03451c9475ab62c51f71714b0cf"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.317523 11881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "6529b03451c9475ab62c51f71714b0cf"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.321053 11881 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 20:45:36.323328 11895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.324450 11881 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:36.324575 11881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "6529b03451c9475ab62c51f71714b0cf"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.324666 11881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:36.349300 11881 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:36.350083 11881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:36.350283 11881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:36.350894 11881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:36.351891 11881 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:36.351944 11881 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.352007 11881 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:36.352038 11881 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.360893 11881 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.132:35493
I20240502 20:45:36.360931 12008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.132:35493 every 8 connection(s)
I20240502 20:45:36.361932 11881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 20:45:36.364068 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 11881
I20240502 20:45:36.364194 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 20:45:36.366746 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.133:0
--local_ip_for_outbound_sockets=127.9.82.133
--webserver_interface=127.9.82.133
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:36.373056 12009 heartbeater.cc:347] Connected to a master server at 127.9.82.190:43461
I20240502 20:45:36.373383 12009 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:36.374258 12009 heartbeater.cc:511] Master 127.9.82.190:43461 requested a full tablet report, sending...
I20240502 20:45:36.375635 11426 ts_manager.cc:194] Registered new tserver with Master: 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493)
I20240502 20:45:36.376278 11426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.132:59413
W20240502 20:45:36.486389 12012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:36.486665 12012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:36.486713 12012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:36.490103 12012 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:36.490204 12012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:36.490284 12012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.133
I20240502 20:45:36.494385 12012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.9.82.133
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--never_fsync=true
--heap_profile_path=/tmp/kudu.12012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.133
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:36.495437 12012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:36.496727 12012 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:36.506191 12017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:36.506744 12018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:36.507519 12020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:36.508731 12012 server_base.cc:1034] running on GCE node
I20240502 20:45:36.509321 12012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:36.510449 12012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:36.511682 12012 hybrid_clock.cc:648] HybridClock initialized: now 1714682736511663 us; error 42 us; skew 500 ppm
I20240502 20:45:36.520853 12012 webserver.cc:460] Webserver started at http://127.9.82.133:41865/ using document root <none> and password file <none>
I20240502 20:45:36.521551 12012 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:36.521623 12012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:36.521831 12012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:36.524020 12012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.524590 12012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.529158 12012 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240502 20:45:36.533073 12026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.534312 12012 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:36.534461 12012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.534600 12012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:36.547617 12012 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:36.548417 12012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:36.548609 12012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:36.549211 12012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:36.550212 12012 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:36.550264 12012 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.550330 12012 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:36.550371 12012 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.560082 12012 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.133:33233
I20240502 20:45:36.560118 12139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.133:33233 every 8 connection(s)
I20240502 20:45:36.561111 12012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 20:45:36.565014 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 12012
I20240502 20:45:36.565138 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20240502 20:45:36.567917 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.134:0
--local_ip_for_outbound_sockets=127.9.82.134
--webserver_interface=127.9.82.134
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:36.571543 12140 heartbeater.cc:347] Connected to a master server at 127.9.82.190:43461
I20240502 20:45:36.571915 12140 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:36.572788 12140 heartbeater.cc:511] Master 127.9.82.190:43461 requested a full tablet report, sending...
I20240502 20:45:36.574266 11426 ts_manager.cc:194] Registered new tserver with Master: 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:36.574891 11426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.133:44221
W20240502 20:45:36.693647 12143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:36.693943 12143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:36.693990 12143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:36.697444 12143 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:36.697547 12143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:36.697621 12143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.134
I20240502 20:45:36.701819 12143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.134:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.9.82.134
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--never_fsync=true
--heap_profile_path=/tmp/kudu.12143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.134
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:36.703053 12143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:36.704319 12143 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:36.713845 12151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:36.714599 12148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:36.715324 12149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:36.716390 12143 server_base.cc:1034] running on GCE node
I20240502 20:45:36.716840 12143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:36.717528 12143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:36.718719 12143 hybrid_clock.cc:648] HybridClock initialized: now 1714682736718686 us; error 62 us; skew 500 ppm
I20240502 20:45:36.721051 12143 webserver.cc:460] Webserver started at http://127.9.82.134:44357/ using document root <none> and password file <none>
I20240502 20:45:36.721688 12143 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:36.721760 12143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:36.721962 12143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:36.723933 12143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "72cfad7451c64ef59a18e09d16a79046"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.724442 12143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "72cfad7451c64ef59a18e09d16a79046"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.728255 12143 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20240502 20:45:36.731420 12157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.733127 12143 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:36.733287 12143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "72cfad7451c64ef59a18e09d16a79046"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.733417 12143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:36.758426 12143 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:36.759285 12143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:36.759486 12143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:36.760159 12143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:36.761247 12143 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:36.761297 12143 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.761339 12143 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:36.761396 12143 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.772248 12143 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.134:41241
I20240502 20:45:36.772272 12270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.134:41241 every 8 connection(s)
I20240502 20:45:36.773313 12143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20240502 20:45:36.776104 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 12143
I20240502 20:45:36.776233 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20240502 20:45:36.778757 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.135:0
--local_ip_for_outbound_sockets=127.9.82.135
--webserver_interface=127.9.82.135
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:45:36.784021 12271 heartbeater.cc:347] Connected to a master server at 127.9.82.190:43461
I20240502 20:45:36.784339 12271 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:36.785181 12271 heartbeater.cc:511] Master 127.9.82.190:43461 requested a full tablet report, sending...
I20240502 20:45:36.786504 11426 ts_manager.cc:194] Registered new tserver with Master: 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:36.787118 11426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.134:36647
I20240502 20:45:36.787834 11616 heartbeater.cc:503] Master 127.9.82.190:43461 was elected leader, sending a full tablet report...
W20240502 20:45:36.896111 12274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:36.896364 12274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:36.896410 12274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:36.899564 12274 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:36.899652 12274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:36.899788 12274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.135
I20240502 20:45:36.903584 12274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.135:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.9.82.135
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--never_fsync=true
--heap_profile_path=/tmp/kudu.12274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.135
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:36.904600 12274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:36.905797 12274 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:36.914990 12279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:36.915326 12280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:36.916450 12282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:36.917268 12274 server_base.cc:1034] running on GCE node
I20240502 20:45:36.917754 12274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:36.918457 12274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:36.919643 12274 hybrid_clock.cc:648] HybridClock initialized: now 1714682736919628 us; error 38 us; skew 500 ppm
I20240502 20:45:36.921937 12274 webserver.cc:460] Webserver started at http://127.9.82.135:38983/ using document root <none> and password file <none>
I20240502 20:45:36.922536 12274 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:36.922595 12274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:36.922758 12274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:45:36.924703 12274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "8824a7df8ec9431db37c0bb434ede060"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.925251 12274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "8824a7df8ec9431db37c0bb434ede060"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.929131 12274 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240502 20:45:36.931939 12288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.933188 12274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:45:36.933373 12274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "8824a7df8ec9431db37c0bb434ede060"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:36.933497 12274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:36.958103 12274 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:36.958842 12274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:36.959020 12274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:36.959632 12274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:36.960646 12274 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:45:36.960700 12274 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.960743 12274 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:45:36.960764 12274 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:36.973627 12274 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.135:44285
I20240502 20:45:36.973664 12402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.135:44285 every 8 connection(s)
I20240502 20:45:36.974874 12274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 20:45:36.977408 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 12274
I20240502 20:45:36.977543 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20240502 20:45:36.980834 11747 heartbeater.cc:503] Master 127.9.82.190:43461 was elected leader, sending a full tablet report...
I20240502 20:45:36.986022 12403 heartbeater.cc:347] Connected to a master server at 127.9.82.190:43461
I20240502 20:45:36.986308 12403 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:36.986964 12403 heartbeater.cc:511] Master 127.9.82.190:43461 requested a full tablet report, sending...
I20240502 20:45:36.988332 11426 ts_manager.cc:194] Registered new tserver with Master: 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285)
I20240502 20:45:36.988937 11426 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.135:57033
I20240502 20:45:36.992622 9546 external_mini_cluster.cc:930] 7 TS(s) registered with all masters
I20240502 20:45:37.004810 11426 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57630:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20240502 20:45:37.032199 12074 tablet_service.cc:1467] Processing CreateTablet for tablet 959ee5415c0a44bbaf7bb3a1ba870902 (DEFAULT_TABLE table=TestTable [id=24950fede60f4eeba3f6c0e0914d81ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:37.033381 12074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 959ee5415c0a44bbaf7bb3a1ba870902. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:37.036186 11812 tablet_service.cc:1467] Processing CreateTablet for tablet 959ee5415c0a44bbaf7bb3a1ba870902 (DEFAULT_TABLE table=TestTable [id=24950fede60f4eeba3f6c0e0914d81ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:37.037292 11812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 959ee5415c0a44bbaf7bb3a1ba870902. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:37.038908 11681 tablet_service.cc:1467] Processing CreateTablet for tablet 959ee5415c0a44bbaf7bb3a1ba870902 (DEFAULT_TABLE table=TestTable [id=24950fede60f4eeba3f6c0e0914d81ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:37.040352 11681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 959ee5415c0a44bbaf7bb3a1ba870902. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:37.045037 12336 tablet_service.cc:1467] Processing CreateTablet for tablet 959ee5415c0a44bbaf7bb3a1ba870902 (DEFAULT_TABLE table=TestTable [id=24950fede60f4eeba3f6c0e0914d81ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:37.045691 12425 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:37.046303 12336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 959ee5415c0a44bbaf7bb3a1ba870902. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:37.049257 12425 tablet_bootstrap.cc:654] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:37.050153 12425 log.cc:824] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:37.050977 12426 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:37.053371 12426 tablet_bootstrap.cc:654] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:37.054267 12428 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:37.054260 12426 log.cc:824] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:37.056597 12428 tablet_bootstrap.cc:654] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:37.056831 12426 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:37.057046 12426 ts_tablet_manager.cc:1367] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240502 20:45:37.057356 11943 tablet_service.cc:1467] Processing CreateTablet for tablet 959ee5415c0a44bbaf7bb3a1ba870902 (DEFAULT_TABLE table=TestTable [id=24950fede60f4eeba3f6c0e0914d81ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:37.058266 11943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 959ee5415c0a44bbaf7bb3a1ba870902. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:37.059948 12428 log.cc:824] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:37.060920 12429 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:37.061535 12426 raft_consensus.cc:348] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.061784 12426 raft_consensus.cc:374] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:37.061841 12426 raft_consensus.cc:729] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:37.063360 12429 tablet_bootstrap.cc:654] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:37.063763 12425 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:37.063977 12425 ts_tablet_manager.cc:1367] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20240502 20:45:37.064258 12429 log.cc:824] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:37.066016 12433 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:37.066207 12428 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:37.066416 12428 ts_tablet_manager.cc:1367] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20240502 20:45:37.067484 12425 raft_consensus.cc:348] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.067770 12425 raft_consensus.cc:374] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:37.067833 12425 raft_consensus.cc:729] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:37.068296 12433 tablet_bootstrap.cc:654] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:37.068303 12425 consensus_queue.cc:260] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.069070 11878 heartbeater.cc:503] Master 127.9.82.190:43461 was elected leader, sending a full tablet report...
I20240502 20:45:37.069131 12433 log.cc:824] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:37.069366 12425 ts_tablet_manager.cc:1398] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20240502 20:45:37.069921 12426 consensus_queue.cc:260] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.070434 12428 raft_consensus.cc:348] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.070660 12428 raft_consensus.cc:374] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:37.070717 12428 raft_consensus.cc:729] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:37.070910 12426 ts_tablet_manager.cc:1398] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20240502 20:45:37.071202 12428 consensus_queue.cc:260] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.072028 12428 ts_tablet_manager.cc:1398] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20240502 20:45:37.072530 12140 heartbeater.cc:503] Master 127.9.82.190:43461 was elected leader, sending a full tablet report...
I20240502 20:45:37.074750 12429 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: No bootstrap required, opened a new log
I20240502 20:45:37.075217 12429 ts_tablet_manager.cc:1367] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20240502 20:45:37.077764 12433 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:37.077965 12433 ts_tablet_manager.cc:1367] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20240502 20:45:37.079196 12429 raft_consensus.cc:348] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.079411 12429 raft_consensus.cc:374] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:37.079447 12429 raft_consensus.cc:729] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: FOLLOWER
I20240502 20:45:37.079988 12429 consensus_queue.cc:260] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.080762 12403 heartbeater.cc:503] Master 127.9.82.190:43461 was elected leader, sending a full tablet report...
I20240502 20:45:37.080917 12433 raft_consensus.cc:348] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.081089 12429 ts_tablet_manager.cc:1398] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240502 20:45:37.081156 12433 raft_consensus.cc:374] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:37.081218 12433 raft_consensus.cc:729] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:37.081678 12433 consensus_queue.cc:260] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.082618 12009 heartbeater.cc:503] Master 127.9.82.190:43461 was elected leader, sending a full tablet report...
I20240502 20:45:37.082674 12433 ts_tablet_manager.cc:1398] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20240502 20:45:37.113384 12010 tablet.cc:2369] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:45:37.115501 12437 raft_consensus.cc:482] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:37.115707 12437 raft_consensus.cc:504] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.117311 12437 leader_election.cc:288] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:37.123490 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "959ee5415c0a44bbaf7bb3a1ba870902" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:37.123901 11832 raft_consensus.cc:2454] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:37.123934 12355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "959ee5415c0a44bbaf7bb3a1ba870902" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8824a7df8ec9431db37c0bb434ede060" is_pre_election: true
I20240502 20:45:37.123935 11701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "959ee5415c0a44bbaf7bb3a1ba870902" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:37.124212 11701 raft_consensus.cc:2454] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:37.124212 12355 raft_consensus.cc:2454] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:37.124635 12030 leader_election.cc:302] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 7dd8e38181f24e349fb179d2a9eb74c1, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:37.124959 12437 raft_consensus.cc:2781] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:37.125030 12437 raft_consensus.cc:482] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:37.125072 12437 raft_consensus.cc:3037] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:37.127921 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "959ee5415c0a44bbaf7bb3a1ba870902" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:37.128260 11963 raft_consensus.cc:2454] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
W20240502 20:45:37.171928 11879 tablet.cc:2369] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:45:37.214722 12437 raft_consensus.cc:504] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.215590 12437 leader_election.cc:288] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 election: Requested vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:37.215919 11701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "959ee5415c0a44bbaf7bb3a1ba870902" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:37.216090 11701 raft_consensus.cc:3037] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:37.216118 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "959ee5415c0a44bbaf7bb3a1ba870902" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3"
I20240502 20:45:37.216243 11832 raft_consensus.cc:3037] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:37.216192 12355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "959ee5415c0a44bbaf7bb3a1ba870902" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8824a7df8ec9431db37c0bb434ede060"
I20240502 20:45:37.216357 12355 raft_consensus.cc:3037] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:37.217370 11832 raft_consensus.cc:2454] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:37.217375 11701 raft_consensus.cc:2454] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
W20240502 20:45:37.217728 11748 tablet.cc:2369] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:45:37.217767 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "959ee5415c0a44bbaf7bb3a1ba870902" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:37.217785 12355 raft_consensus.cc:2454] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:37.217900 11963 raft_consensus.cc:3037] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:37.218499 12030 leader_election.cc:302] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 7dd8e38181f24e349fb179d2a9eb74c1, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:37.218742 12437 raft_consensus.cc:2781] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:37.219000 12437 raft_consensus.cc:686] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Becoming Leader. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Running, Role: LEADER
I20240502 20:45:37.219375 12437 consensus_queue.cc:237] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:37.222990 11426 catalog_manager.cc:5484] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133). New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } }
W20240502 20:45:37.225885 12404 tablet.cc:2369] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:45:37.264895 9546 external_mini_cluster.cc:930] 7 TS(s) registered with all masters
I20240502 20:45:37.267007 9546 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 5521e131639043f8b116f9c71cf4bfee to finish bootstrapping
I20240502 20:45:37.273867 9546 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 8096a2fe270b492baa3178ad9d2976e7 to finish bootstrapping
I20240502 20:45:37.279609 9546 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 07fe14e7347a4682bd8f6026ad776da3 to finish bootstrapping
I20240502 20:45:37.285197 9546 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 6529b03451c9475ab62c51f71714b0cf to finish bootstrapping
I20240502 20:45:37.305918 11963 raft_consensus.cc:2454] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:37.307449 9546 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 7dd8e38181f24e349fb179d2a9eb74c1 to finish bootstrapping
W20240502 20:45:37.312422 12141 tablet.cc:2369] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:45:37.313475 9546 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 72cfad7451c64ef59a18e09d16a79046 to finish bootstrapping
I20240502 20:45:37.319831 9546 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 8824a7df8ec9431db37c0bb434ede060 to finish bootstrapping
I20240502 20:45:37.325013 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 12274
I20240502 20:45:37.687417 12437 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:37.757913 12437 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 20:45:37.764714 12029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.135:44285: connect: Connection refused (error 111)
I20240502 20:45:37.764699 12455 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 20:45:37.766249 12029 consensus_peers.cc:485] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.135:44285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:37.789979 12271 heartbeater.cc:503] Master 127.9.82.190:43461 was elected leader, sending a full tablet report...
W20240502 20:45:40.440464 12029 consensus_peers.cc:485] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.135:44285: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20240502 20:45:41.082566 11425 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57630:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:45:41.090826 11812 tablet_service.cc:1467] Processing CreateTablet for tablet 011b3f9ecb524a54a242425725b72706 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.091202 11812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 011b3f9ecb524a54a242425725b72706. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.091491 11943 tablet_service.cc:1467] Processing CreateTablet for tablet 011b3f9ecb524a54a242425725b72706 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.091876 11943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 011b3f9ecb524a54a242425725b72706. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.092447 12074 tablet_service.cc:1467] Processing CreateTablet for tablet cb2ea660d9044aa7a565ab0c19601244 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.092743 12074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb2ea660d9044aa7a565ab0c19601244. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.093760 12482 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:41.094545 11942 tablet_service.cc:1467] Processing CreateTablet for tablet ed4d27cc41454a108252941a99cd16e2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.094831 11942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4d27cc41454a108252941a99cd16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.094925 11812 tablet_service.cc:1467] Processing CreateTablet for tablet cb2ea660d9044aa7a565ab0c19601244 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.095171 11812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb2ea660d9044aa7a565ab0c19601244. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.095387 12482 tablet_bootstrap.cc:654] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.095886 12073 tablet_service.cc:1467] Processing CreateTablet for tablet ed4d27cc41454a108252941a99cd16e2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.096158 12073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4d27cc41454a108252941a99cd16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.096246 11680 tablet_service.cc:1467] Processing CreateTablet for tablet ed4d27cc41454a108252941a99cd16e2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.096583 11680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4d27cc41454a108252941a99cd16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.096670 12482 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:41.096748 12482 ts_tablet_manager.cc:1367] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 20:45:41.097281 11681 tablet_service.cc:1467] Processing CreateTablet for tablet 011b3f9ecb524a54a242425725b72706 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.097544 11681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 011b3f9ecb524a54a242425725b72706. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.097493 12482 raft_consensus.cc:348] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.097635 12482 raft_consensus.cc:374] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.097669 12482 raft_consensus.cc:729] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.097805 12482 consensus_queue.cc:260] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.098209 12482 ts_tablet_manager.cc:1398] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240502 20:45:41.098523 11678 tablet_service.cc:1467] Processing CreateTablet for tablet cb2ea660d9044aa7a565ab0c19601244 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.098765 11678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb2ea660d9044aa7a565ab0c19601244. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.101372 12486 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:41.101532 12482 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:41.102061 12484 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:41.102366 12486 tablet_bootstrap.cc:654] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.102478 12482 tablet_bootstrap.cc:654] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.103320 12484 tablet_bootstrap.cc:654] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.103713 12489 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:41.103838 12486 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:41.103940 12486 ts_tablet_manager.cc:1367] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:41.104633 12486 raft_consensus.cc:348] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.104734 12482 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:41.104784 12489 tablet_bootstrap.cc:654] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.104822 12482 ts_tablet_manager.cc:1367] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:45:41.104898 12486 raft_consensus.cc:374] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.105003 12486 raft_consensus.cc:729] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.105203 12486 consensus_queue.cc:260] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.105327 12482 raft_consensus.cc:348] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.105476 12482 raft_consensus.cc:374] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.105516 12482 raft_consensus.cc:729] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.105639 12482 consensus_queue.cc:260] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.105937 12482 ts_tablet_manager.cc:1398] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:41.106839 12484 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:41.106979 12484 ts_tablet_manager.cc:1367] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:45:41.107625 12484 raft_consensus.cc:348] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.107873 12484 raft_consensus.cc:374] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.107967 12484 raft_consensus.cc:729] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.108176 12484 consensus_queue.cc:260] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.108673 12484 ts_tablet_manager.cc:1398] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:41.109472 12484 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:41.109808 12486 ts_tablet_manager.cc:1398] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20240502 20:45:41.109789 11549 tablet_service.cc:1467] Processing CreateTablet for tablet cb2ea660d9044aa7a565ab0c19601244 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.110842 12484 tablet_bootstrap.cc:654] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.111289 11549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb2ea660d9044aa7a565ab0c19601244. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.112057 11548 tablet_service.cc:1467] Processing CreateTablet for tablet ed4d27cc41454a108252941a99cd16e2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.112259 12486 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:41.112339 11548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4d27cc41454a108252941a99cd16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.113121 12484 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:41.113215 12484 ts_tablet_manager.cc:1367] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:41.113348 12486 tablet_bootstrap.cc:654] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.113799 12484 raft_consensus.cc:348] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.113926 12484 raft_consensus.cc:374] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.113970 12484 raft_consensus.cc:729] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.114123 12484 consensus_queue.cc:260] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.114574 12484 ts_tablet_manager.cc:1398] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:45:41.116217 11550 tablet_service.cc:1467] Processing CreateTablet for tablet 011b3f9ecb524a54a242425725b72706 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.116549 11550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 011b3f9ecb524a54a242425725b72706. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.116693 12489 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:41.116806 12489 ts_tablet_manager.cc:1367] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20240502 20:45:41.117524 12489 raft_consensus.cc:348] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.117691 12489 raft_consensus.cc:374] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.117727 12489 raft_consensus.cc:729] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.117385 12205 tablet_service.cc:1467] Processing CreateTablet for tablet 011b3f9ecb524a54a242425725b72706 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.117884 12489 consensus_queue.cc:260] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.118294 12489 ts_tablet_manager.cc:1398] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240502 20:45:41.118461 12205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 011b3f9ecb524a54a242425725b72706. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.119019 12489 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:41.119226 12203 tablet_service.cc:1467] Processing CreateTablet for tablet ed4d27cc41454a108252941a99cd16e2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.119516 12203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4d27cc41454a108252941a99cd16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.120606 12489 tablet_bootstrap.cc:654] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.121702 12486 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:41.121840 12486 ts_tablet_manager.cc:1367] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20240502 20:45:41.122354 12486 raft_consensus.cc:348] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.122490 12486 raft_consensus.cc:374] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.122526 12486 raft_consensus.cc:729] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.122604 12204 tablet_service.cc:1467] Processing CreateTablet for tablet cb2ea660d9044aa7a565ab0c19601244 (DEFAULT_TABLE table=rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.122664 12486 consensus_queue.cc:260] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.122901 12204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb2ea660d9044aa7a565ab0c19601244. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.122963 12486 ts_tablet_manager.cc:1398] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:41.125658 12489 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:41.125800 12489 ts_tablet_manager.cc:1367] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20240502 20:45:41.126361 12489 raft_consensus.cc:348] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.126497 12489 raft_consensus.cc:374] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.126535 12489 raft_consensus.cc:729] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.126694 12489 consensus_queue.cc:260] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.127020 12489 ts_tablet_manager.cc:1398] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:41.127233 12489 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:41.127897 12501 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:41.128440 12489 tablet_bootstrap.cc:654] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.129027 12500 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:41.129781 12489 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:41.129889 12489 ts_tablet_manager.cc:1367] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:45:41.130448 12489 raft_consensus.cc:348] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.130587 12489 raft_consensus.cc:374] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.130627 12489 raft_consensus.cc:729] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.130772 12489 consensus_queue.cc:260] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.131078 12489 ts_tablet_manager.cc:1398] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:41.131588 12501 tablet_bootstrap.cc:654] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.131990 12500 tablet_bootstrap.cc:654] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.132943 12501 log.cc:824] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:41.133164 12500 log.cc:824] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:41.134936 12501 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:41.134936 12500 tablet_bootstrap.cc:492] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:41.135145 12501 ts_tablet_manager.cc:1367] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20240502 20:45:41.135147 12500 ts_tablet_manager.cc:1367] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 20:45:41.135206 12465 raft_consensus.cc:482] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:41.135336 12465 raft_consensus.cc:504] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.136138 12465 leader_election.cc:288] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:41.136538 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:41.136701 11963 raft_consensus.cc:2454] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:41.137244 11701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:41.137401 11701 raft_consensus.cc:2454] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:41.137786 12030 leader_election.cc:302] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 6529b03451c9475ab62c51f71714b0cf, 7dd8e38181f24e349fb179d2a9eb74c1, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:41.138254 12465 raft_consensus.cc:2781] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:41.138334 12465 raft_consensus.cc:482] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:41.138386 12465 raft_consensus.cc:3037] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.139168 12501 raft_consensus.cc:348] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.139487 12501 raft_consensus.cc:374] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.139564 12501 raft_consensus.cc:729] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.139568 12465 raft_consensus.cc:504] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.140239 12501 consensus_queue.cc:260] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.141315 12501 ts_tablet_manager.cc:1398] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20240502 20:45:41.141808 12501 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:41.142449 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:41.142946 12501 tablet_bootstrap.cc:654] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.143424 12465 leader_election.cc:288] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 election: Requested vote from peers 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:41.143940 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:41.143968 11701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
W20240502 20:45:41.143972 12030 leader_election.cc:341] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:45:41.144097 11701 raft_consensus.cc:3037] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.144372 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:41.144537 11963 raft_consensus.cc:3037] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
W20240502 20:45:41.144937 12030 leader_election.cc:341] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:45:41.145262 11701 raft_consensus.cc:2454] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:41.141567 12500 raft_consensus.cc:348] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.146273 12501 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:41.146327 12500 raft_consensus.cc:374] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.146453 12501 ts_tablet_manager.cc:1367] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 20:45:41.146505 12500 raft_consensus.cc:729] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.147169 12501 raft_consensus.cc:348] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.147315 12501 raft_consensus.cc:374] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.147358 12501 raft_consensus.cc:729] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.147240 12500 consensus_queue.cc:260] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.147714 12501 consensus_queue.cc:260] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.148073 12501 ts_tablet_manager.cc:1398] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:41.148280 12501 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:41.148442 12225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:41.148516 12500 ts_tablet_manager.cc:1398] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20240502 20:45:41.148730 12225 raft_consensus.cc:2454] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:41.148905 12500 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:41.149057 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:41.149152 12224 raft_consensus.cc:3037] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.149415 12501 tablet_bootstrap.cc:654] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.149892 12500 tablet_bootstrap.cc:654] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.150615 11963 raft_consensus.cc:2454] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:41.150789 12224 raft_consensus.cc:2454] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:41.151305 12030 leader_election.cc:302] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 6529b03451c9475ab62c51f71714b0cf, 7dd8e38181f24e349fb179d2a9eb74c1, 8096a2fe270b492baa3178ad9d2976e7; no voters: 5521e131639043f8b116f9c71cf4bfee
I20240502 20:45:41.151628 12500 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:41.151715 12500 ts_tablet_manager.cc:1367] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:45:41.151844 12465 raft_consensus.cc:2781] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:41.152025 12465 raft_consensus.cc:686] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Becoming Leader. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Running, Role: LEADER
I20240502 20:45:41.152148 12465 consensus_queue.cc:237] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.152400 12500 raft_consensus.cc:348] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.152520 12500 raft_consensus.cc:374] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.152555 12500 raft_consensus.cc:729] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.152719 12500 consensus_queue.cc:260] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.153240 12500 ts_tablet_manager.cc:1398] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:41.153335 12501 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:41.153419 12500 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:41.153414 12501 ts_tablet_manager.cc:1367] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:45:41.154167 11426 catalog_manager.cc:5484] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133). New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } }
I20240502 20:45:41.154435 12500 tablet_bootstrap.cc:654] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.154577 12501 raft_consensus.cc:348] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.154685 12501 raft_consensus.cc:374] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.154726 12501 raft_consensus.cc:729] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.154870 12501 consensus_queue.cc:260] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.155138 12501 ts_tablet_manager.cc:1398] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:41.157191 12500 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:41.157287 12500 ts_tablet_manager.cc:1367] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:45:41.157779 12500 raft_consensus.cc:348] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.157895 12500 raft_consensus.cc:374] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.157927 12500 raft_consensus.cc:729] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.158079 12500 consensus_queue.cc:260] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.158449 12500 ts_tablet_manager.cc:1398] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:41.217561 12508 raft_consensus.cc:482] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:41.217789 12508 raft_consensus.cc:504] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.219020 12508 leader_election.cc:288] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:41.224169 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "5521e131639043f8b116f9c71cf4bfee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:41.224205 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "5521e131639043f8b116f9c71cf4bfee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:41.224411 11963 raft_consensus.cc:2379] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5521e131639043f8b116f9c71cf4bfee in current term 1: Already voted for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in this term.
I20240502 20:45:41.224445 12224 raft_consensus.cc:2379] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5521e131639043f8b116f9c71cf4bfee in current term 1: Already voted for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in this term.
I20240502 20:45:41.225018 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "5521e131639043f8b116f9c71cf4bfee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:41.225579 11505 leader_election.cc:302] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 5521e131639043f8b116f9c71cf4bfee; no voters: 6529b03451c9475ab62c51f71714b0cf, 72cfad7451c64ef59a18e09d16a79046, 7dd8e38181f24e349fb179d2a9eb74c1
I20240502 20:45:41.225908 12508 raft_consensus.cc:3037] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.226114 11701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed4d27cc41454a108252941a99cd16e2" candidate_uuid: "5521e131639043f8b116f9c71cf4bfee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:41.226300 11701 raft_consensus.cc:2379] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5521e131639043f8b116f9c71cf4bfee in current term 1: Already voted for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in this term.
I20240502 20:45:41.227051 12508 raft_consensus.cc:2726] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 20:45:41.230268 12488 raft_consensus.cc:482] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:41.230443 12488 raft_consensus.cc:504] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.231774 12488 leader_election.cc:288] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:41.233209 12506 raft_consensus.cc:482] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:41.233374 12506 raft_consensus.cc:504] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.234879 12506 leader_election.cc:288] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:41.236795 12494 raft_consensus.cc:482] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:41.236936 12494 raft_consensus.cc:504] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.237365 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:41.237551 11570 raft_consensus.cc:2454] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:41.237720 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:41.237859 12224 raft_consensus.cc:2454] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:41.238368 12494 leader_election.cc:288] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:41.238814 11768 leader_election.cc:302] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 5521e131639043f8b116f9c71cf4bfee, 72cfad7451c64ef59a18e09d16a79046; no voters:
I20240502 20:45:41.239099 12488 raft_consensus.cc:2781] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:41.239181 12488 raft_consensus.cc:482] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:41.239234 12488 raft_consensus.cc:3037] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.240967 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:41.241106 11963 raft_consensus.cc:2454] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:41.241041 12488 raft_consensus.cc:504] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.241573 12488 leader_election.cc:288] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Requested vote from peers 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:41.242004 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:41.242141 12224 raft_consensus.cc:3037] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.243288 12224 raft_consensus.cc:2454] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:41.244011 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:41.244149 11570 raft_consensus.cc:3037] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.245185 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb2ea660d9044aa7a565ab0c19601244" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:41.245272 11570 raft_consensus.cc:2454] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:41.245321 11569 raft_consensus.cc:2454] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:41.246120 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:41.246259 11963 raft_consensus.cc:3037] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.246299 11768 leader_election.cc:302] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 5521e131639043f8b116f9c71cf4bfee, 72cfad7451c64ef59a18e09d16a79046; no voters:
I20240502 20:45:41.246824 11701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:41.246980 11701 raft_consensus.cc:2454] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:41.247260 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:41.247383 11700 raft_consensus.cc:3037] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.247433 11963 raft_consensus.cc:2454] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:41.247747 11699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb2ea660d9044aa7a565ab0c19601244" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:41.247867 11699 raft_consensus.cc:2454] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:41.248104 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb2ea660d9044aa7a565ab0c19601244" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:41.248206 12161 leader_election.cc:302] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 5521e131639043f8b116f9c71cf4bfee, 72cfad7451c64ef59a18e09d16a79046, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:41.248257 11832 raft_consensus.cc:2454] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:41.248441 11700 raft_consensus.cc:2454] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:41.248523 12506 raft_consensus.cc:2781] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:41.248584 12506 raft_consensus.cc:482] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:41.248621 12506 raft_consensus.cc:3037] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.248859 12488 raft_consensus.cc:2781] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:41.249109 12488 raft_consensus.cc:686] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Becoming Leader. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Running, Role: LEADER
I20240502 20:45:41.249476 12488 consensus_queue.cc:237] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:41.249681 12506 raft_consensus.cc:504] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.250226 12506 leader_election.cc:288] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 election: Requested vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:41.250430 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb2ea660d9044aa7a565ab0c19601244" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:41.250484 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb2ea660d9044aa7a565ab0c19601244" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3"
I20240502 20:45:41.250582 11832 raft_consensus.cc:3037] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.250602 12094 raft_consensus.cc:2454] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:41.251582 11832 raft_consensus.cc:2454] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:41.251775 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb2ea660d9044aa7a565ab0c19601244" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:41.251929 11569 raft_consensus.cc:3037] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.252193 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb2ea660d9044aa7a565ab0c19601244" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:41.252312 11700 raft_consensus.cc:3037] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.252367 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb2ea660d9044aa7a565ab0c19601244" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
I20240502 20:45:41.252482 12094 raft_consensus.cc:3037] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.253069 11569 raft_consensus.cc:2454] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:41.253273 11700 raft_consensus.cc:2454] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:41.253538 12094 raft_consensus.cc:2454] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:41.253863 11426 catalog_manager.cc:5484] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:41.254446 12161 leader_election.cc:302] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 72cfad7451c64ef59a18e09d16a79046, 7dd8e38181f24e349fb179d2a9eb74c1, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:41.254714 12506 raft_consensus.cc:2781] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:41.254967 12506 raft_consensus.cc:686] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEADER]: Becoming Leader. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Running, Role: LEADER
I20240502 20:45:41.255339 12506 consensus_queue.cc:237] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.256575 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:41.256728 11700 raft_consensus.cc:2379] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6529b03451c9475ab62c51f71714b0cf in current term 1: Already voted for candidate 07fe14e7347a4682bd8f6026ad776da3 in this term.
I20240502 20:45:41.258831 11426 catalog_manager.cc:5484] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134). New cstate: current_term: 1 leader_uuid: "72cfad7451c64ef59a18e09d16a79046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:41.259270 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:41.259471 11569 raft_consensus.cc:2379] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6529b03451c9475ab62c51f71714b0cf in current term 1: Already voted for candidate 07fe14e7347a4682bd8f6026ad776da3 in this term.
I20240502 20:45:41.261186 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:41.261592 11897 leader_election.cc:302] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 6529b03451c9475ab62c51f71714b0cf; no voters: 07fe14e7347a4682bd8f6026ad776da3, 5521e131639043f8b116f9c71cf4bfee, 8096a2fe270b492baa3178ad9d2976e7
I20240502 20:45:41.261835 12494 raft_consensus.cc:2726] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 20:45:41.262271 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "011b3f9ecb524a54a242425725b72706" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:41.262408 12224 raft_consensus.cc:2379] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6529b03451c9475ab62c51f71714b0cf in current term 1: Already voted for candidate 07fe14e7347a4682bd8f6026ad776da3 in this term.
W20240502 20:45:41.275373 11617 tablet.cc:2369] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 20:45:41.277431 12272 tablet.cc:2369] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 20:45:41.384861 12542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:41.385191 12542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:41.388506 12542 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_0'
I20240502 20:45:41.491976 12094 raft_consensus.cc:1261] T cb2ea660d9044aa7a565ab0c19601244 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.492237 11569 raft_consensus.cc:1261] T cb2ea660d9044aa7a565ab0c19601244 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.492743 11700 raft_consensus.cc:1261] T cb2ea660d9044aa7a565ab0c19601244 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.493232 12540 consensus_queue.cc:1035] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.493517 12506 consensus_queue.cc:1035] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.493911 12506 consensus_queue.cc:1035] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.495218 12224 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.495427 11569 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.495877 12538 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.496666 11963 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.496686 11962 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.497259 12465 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.497603 11569 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.497603 11699 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.498059 11700 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.498217 12225 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.498811 12465 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.498822 12488 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.499197 12488 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.499485 12488 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.502426 12511 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.502599 12574 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.506645 12571 mvcc.cc:205] Tried to move back new op lower bound from 7023340509177176064 to 7023340507761229824. Current Snapshot: MvccSnapshot[applied={T|T < 7023340509158363136}]
I20240502 20:45:41.510982 11832 raft_consensus.cc:1261] T cb2ea660d9044aa7a565ab0c19601244 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:41.517933 12573 consensus_queue.cc:1035] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:41.536851 12570 mvcc.cc:205] Tried to move back new op lower bound from 7023340509177176064 to 7023340507761229824. Current Snapshot: MvccSnapshot[applied={T|T < 7023340509158363136}]
I20240502 20:45:41.544875 12572 mvcc.cc:205] Tried to move back new op lower bound from 7023340509154836480 to 7023340508161974272. Current Snapshot: MvccSnapshot[applied={T|T < 7023340509154836480}]
I20240502 20:45:41.548460 12596 mvcc.cc:205] Tried to move back new op lower bound from 7023340509158363136 to 7023340507761229824. Current Snapshot: MvccSnapshot[applied={T|T < 7023340509158363136}]
I20240502 20:45:41.558516 12583 mvcc.cc:205] Tried to move back new op lower bound from 7023340509177176064 to 7023340507761229824. Current Snapshot: MvccSnapshot[applied={T|T < 7023340509158363136}]
I20240502 20:45:41.582528 12591 mvcc.cc:205] Tried to move back new op lower bound from 7023340509177176064 to 7023340507761229824. Current Snapshot: MvccSnapshot[applied={T|T < 7023340509158363136}]
INSERT report
rows total: 2000
time total: 194.172 ms
time per row: 0.0970858 ms
I20240502 20:45:41.635139 11425 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57630:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:45:41.642799 11942 tablet_service.cc:1467] Processing CreateTablet for tablet 8a2169943b994152ba495bdb810754a0 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.642952 11548 tablet_service.cc:1467] Processing CreateTablet for tablet 8a2169943b994152ba495bdb810754a0 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.643010 12205 tablet_service.cc:1467] Processing CreateTablet for tablet 8a2169943b994152ba495bdb810754a0 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.643211 11942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2169943b994152ba495bdb810754a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.643297 12205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2169943b994152ba495bdb810754a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.643325 11548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2169943b994152ba495bdb810754a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.645105 11678 tablet_service.cc:1467] Processing CreateTablet for tablet 067f71582a514a66a0b3fc4681a84471 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.645449 11678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067f71582a514a66a0b3fc4681a84471. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.645776 12501 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:41.646188 12500 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:41.646447 11943 tablet_service.cc:1467] Processing CreateTablet for tablet 067f71582a514a66a0b3fc4681a84471 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.646736 11943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067f71582a514a66a0b3fc4681a84471. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.646798 12501 tablet_bootstrap.cc:654] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.647475 12500 tablet_bootstrap.cc:654] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.648203 11942 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbffeb3e45e4ab78112632675d55ac6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.648350 11550 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbffeb3e45e4ab78112632675d55ac6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.648644 11550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbffeb3e45e4ab78112632675d55ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.648646 11942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbffeb3e45e4ab78112632675d55ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.649273 12500 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:41.649384 12500 ts_tablet_manager.cc:1367] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:45:41.649909 12500 raft_consensus.cc:348] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.650046 12500 raft_consensus.cc:374] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.650080 12500 raft_consensus.cc:729] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.650214 12500 consensus_queue.cc:260] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.650547 12500 ts_tablet_manager.cc:1398] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:41.650996 12500 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:41.650943 11549 tablet_service.cc:1467] Processing CreateTablet for tablet 067f71582a514a66a0b3fc4681a84471 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.651173 11549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067f71582a514a66a0b3fc4681a84471. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.651980 12500 tablet_bootstrap.cc:654] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.652304 12072 tablet_service.cc:1467] Processing CreateTablet for tablet 067f71582a514a66a0b3fc4681a84471 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.652561 12074 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbffeb3e45e4ab78112632675d55ac6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.652637 12072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067f71582a514a66a0b3fc4681a84471. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.652778 12074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbffeb3e45e4ab78112632675d55ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.653699 12500 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:41.653774 12500 ts_tablet_manager.cc:1367] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:41.652304 12073 tablet_service.cc:1467] Processing CreateTablet for tablet 8a2169943b994152ba495bdb810754a0 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.653975 12073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2169943b994152ba495bdb810754a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.654275 12500 raft_consensus.cc:348] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.654415 12500 raft_consensus.cc:374] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.654454 12500 raft_consensus.cc:729] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.654634 12500 consensus_queue.cc:260] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.655033 12500 ts_tablet_manager.cc:1398] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:41.655181 12500 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:41.656101 12500 tablet_bootstrap.cc:654] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.656492 11812 tablet_service.cc:1467] Processing CreateTablet for tablet 8a2169943b994152ba495bdb810754a0 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.656788 11812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2169943b994152ba495bdb810754a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.656914 12628 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:41.657673 12624 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:41.657755 12628 tablet_bootstrap.cc:654] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.658608 12501 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:41.658736 12501 ts_tablet_manager.cc:1367] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 20:45:41.658757 12624 tablet_bootstrap.cc:654] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.658867 12630 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:41.659279 12501 raft_consensus.cc:348] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.659348 11811 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbffeb3e45e4ab78112632675d55ac6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.659413 12501 raft_consensus.cc:374] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.659472 12501 raft_consensus.cc:729] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.659607 11811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbffeb3e45e4ab78112632675d55ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.659624 12501 consensus_queue.cc:260] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.659875 12630 tablet_bootstrap.cc:654] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.660120 11810 tablet_service.cc:1467] Processing CreateTablet for tablet 067f71582a514a66a0b3fc4681a84471 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.660390 11810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067f71582a514a66a0b3fc4681a84471. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.661007 12628 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:41.661115 12628 ts_tablet_manager.cc:1367] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:41.661652 12628 raft_consensus.cc:348] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.661795 12628 raft_consensus.cc:374] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.661828 12628 raft_consensus.cc:729] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.661785 12205 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbffeb3e45e4ab78112632675d55ac6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:41.661967 12628 consensus_queue.cc:260] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.662108 12205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbffeb3e45e4ab78112632675d55ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:41.663089 12628 ts_tablet_manager.cc:1398] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:41.663301 12628 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:41.664371 12501 ts_tablet_manager.cc:1398] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:45:41.664685 12501 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:41.665591 12632 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:41.666375 12501 tablet_bootstrap.cc:654] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.666697 12632 tablet_bootstrap.cc:654] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.666919 12628 tablet_bootstrap.cc:654] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.667644 12501 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:41.667789 12501 ts_tablet_manager.cc:1367] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:41.667977 12500 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:41.667970 12630 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:41.668079 12500 ts_tablet_manager.cc:1367] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 20:45:41.668079 12630 ts_tablet_manager.cc:1367] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20240502 20:45:41.668351 12628 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:41.668344 12501 raft_consensus.cc:348] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.668488 12501 raft_consensus.cc:374] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.668519 12501 raft_consensus.cc:729] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.668547 12500 raft_consensus.cc:348] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.668548 12630 raft_consensus.cc:348] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.668666 12630 raft_consensus.cc:374] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.668666 12500 raft_consensus.cc:374] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.668700 12500 raft_consensus.cc:729] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.668700 12630 raft_consensus.cc:729] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.668694 12501 consensus_queue.cc:260] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.668850 12500 consensus_queue.cc:260] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.668869 12630 consensus_queue.cc:260] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.669092 12501 ts_tablet_manager.cc:1398] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:41.669139 12500 ts_tablet_manager.cc:1398] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:41.670033 12632 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:41.670159 12632 ts_tablet_manager.cc:1367] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:45:41.670166 12628 ts_tablet_manager.cc:1367] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20240502 20:45:41.670608 12628 raft_consensus.cc:348] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.670725 12628 raft_consensus.cc:374] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.670672 12632 raft_consensus.cc:348] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.670760 12628 raft_consensus.cc:729] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.670799 12632 raft_consensus.cc:374] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.670861 12632 raft_consensus.cc:729] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.670912 12628 consensus_queue.cc:260] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.671013 12632 consensus_queue.cc:260] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.671314 12632 ts_tablet_manager.cc:1398] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:41.671499 12632 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:41.671659 12628 ts_tablet_manager.cc:1398] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:41.671890 12628 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:41.672571 12632 tablet_bootstrap.cc:654] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.673802 12628 tablet_bootstrap.cc:654] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.674139 12632 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:41.674242 12632 ts_tablet_manager.cc:1367] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:41.674750 12632 raft_consensus.cc:348] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.674906 12632 raft_consensus.cc:374] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.674948 12632 raft_consensus.cc:729] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.675098 12632 consensus_queue.cc:260] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.675446 12632 ts_tablet_manager.cc:1398] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:41.675637 12632 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:41.676098 12630 ts_tablet_manager.cc:1398] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20240502 20:45:41.676770 12632 tablet_bootstrap.cc:654] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.677242 12624 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:41.677348 12624 ts_tablet_manager.cc:1367] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20240502 20:45:41.677889 12624 raft_consensus.cc:348] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.678023 12624 raft_consensus.cc:374] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.678062 12624 raft_consensus.cc:729] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.678357 12624 consensus_queue.cc:260] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.678705 12624 ts_tablet_manager.cc:1398] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:45:41.678975 12624 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:41.680656 12632 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:41.680774 12632 ts_tablet_manager.cc:1367] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:45:41.680874 12624 tablet_bootstrap.cc:654] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.681381 12632 raft_consensus.cc:348] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.681531 12632 raft_consensus.cc:374] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.681569 12632 raft_consensus.cc:729] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.681730 12632 consensus_queue.cc:260] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.682090 12632 ts_tablet_manager.cc:1398] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:41.682185 12624 tablet_bootstrap.cc:492] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:41.682274 12624 ts_tablet_manager.cc:1367] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:41.683351 12624 raft_consensus.cc:348] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.683496 12624 raft_consensus.cc:374] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.683543 12624 raft_consensus.cc:729] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.683698 12624 consensus_queue.cc:260] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.684113 12628 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:41.684195 12624 ts_tablet_manager.cc:1398] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:41.684232 12628 ts_tablet_manager.cc:1367] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20240502 20:45:41.684387 12624 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:41.684758 12628 raft_consensus.cc:348] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.684918 12628 raft_consensus.cc:374] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.684957 12628 raft_consensus.cc:729] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.685096 12628 consensus_queue.cc:260] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.685380 12628 ts_tablet_manager.cc:1398] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:41.686043 12624 tablet_bootstrap.cc:654] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:41.687395 12624 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:41.687494 12624 ts_tablet_manager.cc:1367] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:41.687995 12624 raft_consensus.cc:348] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.688103 12624 raft_consensus.cc:374] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:41.688138 12624 raft_consensus.cc:729] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:41.688289 12624 consensus_queue.cc:260] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.688570 12624 ts_tablet_manager.cc:1398] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:41.700711 12538 raft_consensus.cc:482] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:41.700886 12538 raft_consensus.cc:504] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.701591 12538 leader_election.cc:288] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:41.702090 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbffeb3e45e4ab78112632675d55ac6" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:41.702039 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbffeb3e45e4ab78112632675d55ac6" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:41.702252 11570 raft_consensus.cc:2454] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:41.702273 12224 raft_consensus.cc:2454] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:41.702327 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbffeb3e45e4ab78112632675d55ac6" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:41.702484 11963 raft_consensus.cc:2454] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:41.702687 11768 leader_election.cc:302] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 5521e131639043f8b116f9c71cf4bfee, 72cfad7451c64ef59a18e09d16a79046; no voters:
I20240502 20:45:41.702960 12538 raft_consensus.cc:2781] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:41.703032 12538 raft_consensus.cc:482] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:41.703086 12538 raft_consensus.cc:3037] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.704221 12538 raft_consensus.cc:504] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.704790 12538 leader_election.cc:288] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Requested vote from peers 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:41.705104 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbffeb3e45e4ab78112632675d55ac6" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:41.705132 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbffeb3e45e4ab78112632675d55ac6" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:41.705164 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbffeb3e45e4ab78112632675d55ac6" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:41.705243 12224 raft_consensus.cc:3037] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.705267 11570 raft_consensus.cc:3037] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.705278 11963 raft_consensus.cc:3037] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.706364 12224 raft_consensus.cc:2454] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:41.706364 11963 raft_consensus.cc:2454] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:41.706414 11570 raft_consensus.cc:2454] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:41.706871 11768 leader_election.cc:302] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 6529b03451c9475ab62c51f71714b0cf, 72cfad7451c64ef59a18e09d16a79046; no voters:
I20240502 20:45:41.707091 12538 raft_consensus.cc:2781] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:41.707208 12538 raft_consensus.cc:686] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Becoming Leader. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Running, Role: LEADER
I20240502 20:45:41.707412 12538 consensus_queue.cc:237] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.707432 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbffeb3e45e4ab78112632675d55ac6" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:41.707576 12094 raft_consensus.cc:2454] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:41.707700 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbffeb3e45e4ab78112632675d55ac6" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
I20240502 20:45:41.707863 12093 raft_consensus.cc:3037] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.709403 12093 raft_consensus.cc:2454] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:41.709604 11425 catalog_manager.cc:5484] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:41.923332 12465 raft_consensus.cc:482] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:41.923496 12465 raft_consensus.cc:504] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.924113 12465 leader_election.cc:288] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493)
I20240502 20:45:41.924575 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067f71582a514a66a0b3fc4681a84471" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:41.924576 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067f71582a514a66a0b3fc4681a84471" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:41.924666 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067f71582a514a66a0b3fc4681a84471" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:41.924666 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067f71582a514a66a0b3fc4681a84471" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:41.924727 11832 raft_consensus.cc:2454] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:41.924727 11700 raft_consensus.cc:2454] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:41.924823 11963 raft_consensus.cc:2454] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:41.924823 11570 raft_consensus.cc:2454] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:41.925102 12030 leader_election.cc:302] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 7dd8e38181f24e349fb179d2a9eb74c1, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:41.925305 12465 raft_consensus.cc:2781] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:41.925374 12465 raft_consensus.cc:482] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:41.925419 12465 raft_consensus.cc:3037] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.926294 12465 raft_consensus.cc:504] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.926752 12465 leader_election.cc:288] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 election: Requested vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493)
I20240502 20:45:41.927124 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067f71582a514a66a0b3fc4681a84471" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3"
I20240502 20:45:41.927172 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067f71582a514a66a0b3fc4681a84471" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:41.927160 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067f71582a514a66a0b3fc4681a84471" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:41.927227 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067f71582a514a66a0b3fc4681a84471" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:41.927266 11832 raft_consensus.cc:3037] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.927299 11570 raft_consensus.cc:3037] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.927299 11700 raft_consensus.cc:3037] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.927348 11963 raft_consensus.cc:3037] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.928386 11832 raft_consensus.cc:2454] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:41.928386 11963 raft_consensus.cc:2454] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:41.928390 11700 raft_consensus.cc:2454] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:41.928579 11570 raft_consensus.cc:2454] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:41.928763 12030 leader_election.cc:302] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 6529b03451c9475ab62c51f71714b0cf, 7dd8e38181f24e349fb179d2a9eb74c1; no voters:
I20240502 20:45:41.928972 12465 raft_consensus.cc:2781] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:41.929070 12465 raft_consensus.cc:686] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Becoming Leader. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Running, Role: LEADER
I20240502 20:45:41.929248 12494 raft_consensus.cc:482] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:41.929309 12465 consensus_queue.cc:237] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:41.929383 12494 raft_consensus.cc:504] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.930068 12494 leader_election.cc:288] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:41.930512 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2169943b994152ba495bdb810754a0" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:41.930645 11570 raft_consensus.cc:2454] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 0.
I20240502 20:45:41.930647 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2169943b994152ba495bdb810754a0" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:41.930794 12224 raft_consensus.cc:2454] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 0.
I20240502 20:45:41.931023 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2169943b994152ba495bdb810754a0" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:41.931170 11832 raft_consensus.cc:2454] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 0.
I20240502 20:45:41.931186 11897 leader_election.cc:302] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 5521e131639043f8b116f9c71cf4bfee, 6529b03451c9475ab62c51f71714b0cf, 72cfad7451c64ef59a18e09d16a79046; no voters:
I20240502 20:45:41.931380 12494 raft_consensus.cc:2781] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:41.931424 12494 raft_consensus.cc:482] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:41.931458 12494 raft_consensus.cc:3037] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.932498 11425 catalog_manager.cc:5484] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133). New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } }
I20240502 20:45:41.932746 12494 raft_consensus.cc:504] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.933743 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2169943b994152ba495bdb810754a0" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:41.933843 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2169943b994152ba495bdb810754a0" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:41.933890 12224 raft_consensus.cc:3037] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.933966 11570 raft_consensus.cc:3037] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.934984 11570 raft_consensus.cc:2454] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 1.
I20240502 20:45:41.934984 12224 raft_consensus.cc:2454] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 1.
I20240502 20:45:41.935842 11897 leader_election.cc:302] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 5521e131639043f8b116f9c71cf4bfee, 6529b03451c9475ab62c51f71714b0cf, 72cfad7451c64ef59a18e09d16a79046; no voters:
I20240502 20:45:41.935897 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2169943b994152ba495bdb810754a0" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:41.936044 12093 raft_consensus.cc:2454] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 0.
I20240502 20:45:41.936352 12494 leader_election.cc:288] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 election: Requested vote from peers 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:41.936481 12646 raft_consensus.cc:2781] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:41.936611 12646 raft_consensus.cc:686] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Becoming Leader. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Running, Role: LEADER
I20240502 20:45:41.936903 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2169943b994152ba495bdb810754a0" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3"
I20240502 20:45:41.937062 11832 raft_consensus.cc:3037] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.936972 12646 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:41.937803 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a2169943b994152ba495bdb810754a0" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
I20240502 20:45:41.937944 12093 raft_consensus.cc:3037] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:41.938225 11832 raft_consensus.cc:2454] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 1.
I20240502 20:45:41.939119 12093 raft_consensus.cc:2454] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 1.
I20240502 20:45:41.940608 11425 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 6529b03451c9475ab62c51f71714b0cf (127.9.82.132). New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } }
W20240502 20:45:42.084290 12648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:42.084621 12648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:42.088003 12648 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_1'
I20240502 20:45:42.123010 12538 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.144117 12538 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.158728 12576 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.161715 12576 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.201045 11832 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.201066 12224 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.201179 11570 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.201558 12093 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.201694 12494 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.202031 12646 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.207094 12494 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.207517 12494 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.210146 11963 raft_consensus.cc:1261] T 067f71582a514a66a0b3fc4681a84471 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.211977 11569 raft_consensus.cc:1261] T 067f71582a514a66a0b3fc4681a84471 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.212046 11831 raft_consensus.cc:1261] T 067f71582a514a66a0b3fc4681a84471 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.212456 11700 raft_consensus.cc:1261] T 067f71582a514a66a0b3fc4681a84471 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.212522 12465 consensus_queue.cc:1035] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.218118 12465 consensus_queue.cc:1035] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.218531 12697 consensus_queue.cc:1035] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.228142 12465 consensus_queue.cc:1035] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 179.567 ms
time per row: 0.0897835 ms
I20240502 20:45:42.325718 11420 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57630:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:45:42.333997 11678 tablet_service.cc:1467] Processing CreateTablet for tablet 81c3873a4eab471da0c19e8bf0eaf03d (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.334018 11942 tablet_service.cc:1467] Processing CreateTablet for tablet 81c3873a4eab471da0c19e8bf0eaf03d (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.334069 11811 tablet_service.cc:1467] Processing CreateTablet for tablet 81c3873a4eab471da0c19e8bf0eaf03d (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.334383 11678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81c3873a4eab471da0c19e8bf0eaf03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.334381 11942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81c3873a4eab471da0c19e8bf0eaf03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.334419 11811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81c3873a4eab471da0c19e8bf0eaf03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.336027 11550 tablet_service.cc:1467] Processing CreateTablet for tablet d2a72d81232b487ea716903ddb2e0296 (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.336313 11550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2a72d81232b487ea716903ddb2e0296. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.337208 12205 tablet_service.cc:1467] Processing CreateTablet for tablet 81c3873a4eab471da0c19e8bf0eaf03d (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.337558 12205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81c3873a4eab471da0c19e8bf0eaf03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.337550 11811 tablet_service.cc:1467] Processing CreateTablet for tablet d2a72d81232b487ea716903ddb2e0296 (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.337694 12734 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:42.337813 11811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2a72d81232b487ea716903ddb2e0296. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.338760 12734 tablet_bootstrap.cc:654] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.339130 11548 tablet_service.cc:1467] Processing CreateTablet for tablet 319f281517f54ed6998fd74a849b07eb (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.339412 11548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319f281517f54ed6998fd74a849b07eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.339607 12735 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:42.340526 12203 tablet_service.cc:1467] Processing CreateTablet for tablet d2a72d81232b487ea716903ddb2e0296 (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.340685 12735 tablet_bootstrap.cc:654] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.340840 12203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2a72d81232b487ea716903ddb2e0296. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.341869 12735 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:42.341816 11549 tablet_service.cc:1467] Processing CreateTablet for tablet 81c3873a4eab471da0c19e8bf0eaf03d (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.341980 12735 ts_tablet_manager.cc:1367] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:42.342110 11549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81c3873a4eab471da0c19e8bf0eaf03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.342209 12737 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:42.342531 12735 raft_consensus.cc:348] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.342664 12735 raft_consensus.cc:374] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.342700 12735 raft_consensus.cc:729] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.342839 12735 consensus_queue.cc:260] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.343165 12735 ts_tablet_manager.cc:1398] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:42.343679 12204 tablet_service.cc:1467] Processing CreateTablet for tablet 319f281517f54ed6998fd74a849b07eb (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.343997 12204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319f281517f54ed6998fd74a849b07eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.344276 12737 tablet_bootstrap.cc:654] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.344543 11678 tablet_service.cc:1467] Processing CreateTablet for tablet d2a72d81232b487ea716903ddb2e0296 (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.344827 11678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2a72d81232b487ea716903ddb2e0296. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.345391 12740 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:42.346518 12740 tablet_bootstrap.cc:654] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.346742 12735 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:42.346998 11681 tablet_service.cc:1467] Processing CreateTablet for tablet 319f281517f54ed6998fd74a849b07eb (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.347262 11681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319f281517f54ed6998fd74a849b07eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.347780 12735 tablet_bootstrap.cc:654] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.349079 12735 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:42.349082 12734 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:42.349175 12734 ts_tablet_manager.cc:1367] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20240502 20:45:42.349195 12735 ts_tablet_manager.cc:1367] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:45:42.349442 12073 tablet_service.cc:1467] Processing CreateTablet for tablet d2a72d81232b487ea716903ddb2e0296 (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.349687 12073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2a72d81232b487ea716903ddb2e0296. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.349663 12735 raft_consensus.cc:348] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.349679 12734 raft_consensus.cc:348] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.349785 12735 raft_consensus.cc:374] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.349785 12734 raft_consensus.cc:374] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.349821 12735 raft_consensus.cc:729] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.349834 12734 raft_consensus.cc:729] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.349965 12735 consensus_queue.cc:260] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.349965 12734 consensus_queue.cc:260] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.350246 12734 ts_tablet_manager.cc:1398] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:42.350755 12735 ts_tablet_manager.cc:1398] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:45:42.352056 12074 tablet_service.cc:1467] Processing CreateTablet for tablet 319f281517f54ed6998fd74a849b07eb (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.352330 12074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319f281517f54ed6998fd74a849b07eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.355307 11942 tablet_service.cc:1467] Processing CreateTablet for tablet 319f281517f54ed6998fd74a849b07eb (DEFAULT_TABLE table=rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:42.355645 11942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319f281517f54ed6998fd74a849b07eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:42.357420 12740 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:42.357545 12740 ts_tablet_manager.cc:1367] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20240502 20:45:42.357985 12740 raft_consensus.cc:348] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.358088 12740 raft_consensus.cc:374] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.358124 12740 raft_consensus.cc:729] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.358273 12740 consensus_queue.cc:260] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.358363 12734 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:42.358551 12740 ts_tablet_manager.cc:1398] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:42.358714 12740 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:42.359437 12734 tablet_bootstrap.cc:654] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.359597 12740 tablet_bootstrap.cc:654] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.360047 12743 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:42.360723 12689 raft_consensus.cc:482] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:42.360854 12689 raft_consensus.cc:504] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.361063 12743 tablet_bootstrap.cc:654] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.361402 12689 leader_election.cc:288] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161)
I20240502 20:45:42.361771 12736 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:42.361912 12734 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:42.361999 12734 ts_tablet_manager.cc:1367] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:42.362339 12735 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:42.362490 12734 raft_consensus.cc:348] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.362620 12734 raft_consensus.cc:374] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.362674 12734 raft_consensus.cc:729] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.362772 12736 tablet_bootstrap.cc:654] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.362833 12734 consensus_queue.cc:260] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.363190 12734 ts_tablet_manager.cc:1398] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:42.363656 12735 tablet_bootstrap.cc:654] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.364301 12737 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:42.364434 12737 ts_tablet_manager.cc:1367] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20240502 20:45:42.364889 12743 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:42.364998 12743 ts_tablet_manager.cc:1367] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:45:42.365033 12740 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:42.365120 12740 ts_tablet_manager.cc:1367] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:45:42.365049 12737 raft_consensus.cc:348] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.365166 12737 raft_consensus.cc:374] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.365200 12737 raft_consensus.cc:729] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.365353 12737 consensus_queue.cc:260] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.365569 12740 raft_consensus.cc:348] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.365665 12737 ts_tablet_manager.cc:1398] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:42.365681 12740 raft_consensus.cc:374] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.365710 12740 raft_consensus.cc:729] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.365865 12737 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:42.365833 12740 consensus_queue.cc:260] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.366111 12740 ts_tablet_manager.cc:1398] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:42.366149 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:42.366168 12743 raft_consensus.cc:348] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.366292 12740 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:42.366328 12743 raft_consensus.cc:374] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.366364 12743 raft_consensus.cc:729] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.366554 12743 consensus_queue.cc:260] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
W20240502 20:45:42.366822 11897 leader_election.cc:341] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:45:42.366961 12743 ts_tablet_manager.cc:1398] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:42.367110 12743 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:42.367259 12740 tablet_bootstrap.cc:654] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.367228 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:42.367539 12737 tablet_bootstrap.cc:654] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.367762 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
W20240502 20:45:42.368327 11899 leader_election.cc:341] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:45:42.368404 12743 tablet_bootstrap.cc:654] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
W20240502 20:45:42.368654 11897 leader_election.cc:341] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:45:42.368742 11897 leader_election.cc:302] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 6529b03451c9475ab62c51f71714b0cf; no voters: 07fe14e7347a4682bd8f6026ad776da3, 5521e131639043f8b116f9c71cf4bfee, 72cfad7451c64ef59a18e09d16a79046
I20240502 20:45:42.368924 12689 raft_consensus.cc:2726] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 20:45:42.369657 12736 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:42.369736 12743 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:42.369771 12740 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:42.369779 12736 ts_tablet_manager.cc:1367] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 20:45:42.369815 12743 ts_tablet_manager.cc:1367] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:42.369755 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:42.369855 12740 ts_tablet_manager.cc:1367] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:42.369923 11700 raft_consensus.cc:2454] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 0.
I20240502 20:45:42.370332 12736 raft_consensus.cc:348] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.370450 12736 raft_consensus.cc:374] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.370486 12736 raft_consensus.cc:729] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.370497 12743 raft_consensus.cc:348] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.370605 12743 raft_consensus.cc:374] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.370641 12743 raft_consensus.cc:729] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.370599 12740 raft_consensus.cc:348] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.370631 12736 consensus_queue.cc:260] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.370712 12740 raft_consensus.cc:374] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.370744 12740 raft_consensus.cc:729] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.370795 12743 consensus_queue.cc:260] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.370968 12736 ts_tablet_manager.cc:1398] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:42.371158 12736 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:42.371152 12743 ts_tablet_manager.cc:1398] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:42.372172 12736 tablet_bootstrap.cc:654] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.372855 12737 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:42.372979 12737 ts_tablet_manager.cc:1367] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20240502 20:45:42.373201 12735 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:42.373323 12735 ts_tablet_manager.cc:1367] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20240502 20:45:42.373531 12737 raft_consensus.cc:348] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.373651 12737 raft_consensus.cc:374] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.373684 12737 raft_consensus.cc:729] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.373839 12737 consensus_queue.cc:260] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.373833 12735 raft_consensus.cc:348] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.373947 12735 raft_consensus.cc:374] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.373979 12735 raft_consensus.cc:729] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.374158 12737 ts_tablet_manager.cc:1398] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240502 20:45:42.374130 12735 consensus_queue.cc:260] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.374333 12737 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:42.374451 12735 ts_tablet_manager.cc:1398] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 20:45:42.375370 12737 tablet_bootstrap.cc:654] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:42.376421 12740 consensus_queue.cc:260] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.378226 12740 ts_tablet_manager.cc:1398] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20240502 20:45:42.382534 12736 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:42.382666 12736 ts_tablet_manager.cc:1367] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20240502 20:45:42.383144 12736 raft_consensus.cc:348] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.383260 12736 raft_consensus.cc:374] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.383296 12736 raft_consensus.cc:729] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.383450 12736 consensus_queue.cc:260] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.383806 12736 ts_tablet_manager.cc:1398] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240502 20:45:42.384637 12737 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:42.384752 12737 ts_tablet_manager.cc:1367] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20240502 20:45:42.385308 12737 raft_consensus.cc:348] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.385447 12737 raft_consensus.cc:374] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:42.385489 12737 raft_consensus.cc:729] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:42.385650 12737 consensus_queue.cc:260] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.385959 12737 ts_tablet_manager.cc:1398] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 20:45:42.393689 12696 raft_consensus.cc:482] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:42.393899 12696 raft_consensus.cc:504] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.394543 12696 leader_election.cc:288] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161)
I20240502 20:45:42.394989 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319f281517f54ed6998fd74a849b07eb" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:42.395072 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319f281517f54ed6998fd74a849b07eb" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:42.395159 12224 raft_consensus.cc:2454] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:42.395231 11569 raft_consensus.cc:2454] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:42.395212 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319f281517f54ed6998fd74a849b07eb" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:42.395337 11963 raft_consensus.cc:2454] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:42.395639 12030 leader_election.cc:302] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 5521e131639043f8b116f9c71cf4bfee, 72cfad7451c64ef59a18e09d16a79046, 7dd8e38181f24e349fb179d2a9eb74c1; no voters:
I20240502 20:45:42.395646 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319f281517f54ed6998fd74a849b07eb" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:42.395818 11700 raft_consensus.cc:2454] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 0.
I20240502 20:45:42.395869 12696 raft_consensus.cc:2781] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:42.395932 12696 raft_consensus.cc:482] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:42.395967 12696 raft_consensus.cc:3037] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.428176 12696 raft_consensus.cc:504] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.428901 12696 leader_election.cc:288] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 election: Requested vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161)
I20240502 20:45:42.429306 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319f281517f54ed6998fd74a849b07eb" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:42.429380 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319f281517f54ed6998fd74a849b07eb" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:42.429461 12224 raft_consensus.cc:3037] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.429443 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319f281517f54ed6998fd74a849b07eb" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:42.429540 11963 raft_consensus.cc:3037] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.429576 11700 raft_consensus.cc:3037] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.429649 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "319f281517f54ed6998fd74a849b07eb" candidate_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:42.429783 11569 raft_consensus.cc:3037] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.430605 11700 raft_consensus.cc:2454] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:42.430605 12224 raft_consensus.cc:2454] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:42.430840 11963 raft_consensus.cc:2454] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:42.430899 11569 raft_consensus.cc:2454] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dd8e38181f24e349fb179d2a9eb74c1 in term 1.
I20240502 20:45:42.431202 12030 leader_election.cc:302] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 72cfad7451c64ef59a18e09d16a79046, 7dd8e38181f24e349fb179d2a9eb74c1, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:42.431422 12696 raft_consensus.cc:2781] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:42.431952 12696 raft_consensus.cc:686] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Becoming Leader. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Running, Role: LEADER
I20240502 20:45:42.432397 12696 consensus_queue.cc:237] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.435240 11425 catalog_manager.cc:5484] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133). New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:42.580283 12725 raft_consensus.cc:482] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:42.580466 12725 raft_consensus.cc:504] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.581341 12725 leader_election.cc:288] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161)
I20240502 20:45:42.581395 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2a72d81232b487ea716903ddb2e0296" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:42.581559 12224 raft_consensus.cc:2454] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:42.581633 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2a72d81232b487ea716903ddb2e0296" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:42.581800 11700 raft_consensus.cc:2454] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:42.581878 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2a72d81232b487ea716903ddb2e0296" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:42.582015 12094 raft_consensus.cc:2454] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:42.582271 11768 leader_election.cc:302] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 72cfad7451c64ef59a18e09d16a79046, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:42.582350 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2a72d81232b487ea716903ddb2e0296" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:42.582494 11569 raft_consensus.cc:2454] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:42.582547 12725 raft_consensus.cc:2781] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:42.582623 12725 raft_consensus.cc:482] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:42.582674 12725 raft_consensus.cc:3037] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.583686 12725 raft_consensus.cc:504] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.584298 12725 leader_election.cc:288] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Requested vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161)
I20240502 20:45:42.584741 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2a72d81232b487ea716903ddb2e0296" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:42.584897 11700 raft_consensus.cc:3037] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.585014 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2a72d81232b487ea716903ddb2e0296" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:42.585134 11569 raft_consensus.cc:3037] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.585156 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2a72d81232b487ea716903ddb2e0296" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:42.585271 12224 raft_consensus.cc:3037] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.586066 11569 raft_consensus.cc:2454] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:42.586052 11700 raft_consensus.cc:2454] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:42.586262 12224 raft_consensus.cc:2454] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:42.586544 11768 leader_election.cc:302] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 5521e131639043f8b116f9c71cf4bfee, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:42.586678 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2a72d81232b487ea716903ddb2e0296" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
I20240502 20:45:42.586751 12725 raft_consensus.cc:2781] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:42.586805 12094 raft_consensus.cc:3037] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.586998 12725 raft_consensus.cc:686] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Becoming Leader. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Running, Role: LEADER
I20240502 20:45:42.587198 12725 consensus_queue.cc:237] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.588133 12094 raft_consensus.cc:2454] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:42.589584 11425 catalog_manager.cc:5484] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:42.616140 12725 raft_consensus.cc:482] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:42.616355 12725 raft_consensus.cc:504] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.616932 12725 leader_election.cc:288] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161)
I20240502 20:45:42.617457 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:42.617470 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:42.617492 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:42.617492 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:42.617626 11963 raft_consensus.cc:2454] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:42.617626 12224 raft_consensus.cc:2454] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:42.617663 11700 raft_consensus.cc:2454] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:42.617663 11569 raft_consensus.cc:2454] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:42.618108 11768 leader_election.cc:302] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 72cfad7451c64ef59a18e09d16a79046, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:42.618348 12725 raft_consensus.cc:2781] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:42.618417 12725 raft_consensus.cc:482] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:42.618474 12725 raft_consensus.cc:3037] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.619525 12725 raft_consensus.cc:504] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.620103 12725 leader_election.cc:288] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Requested vote from peers 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161)
I20240502 20:45:42.620563 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:42.620563 12224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:42.620643 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:42.620643 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:42.620707 11963 raft_consensus.cc:3037] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.620723 12224 raft_consensus.cc:3037] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.620792 11569 raft_consensus.cc:3037] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.620822 11700 raft_consensus.cc:3037] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:42.621769 12224 raft_consensus.cc:2454] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:42.621769 11963 raft_consensus.cc:2454] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:42.621877 11700 raft_consensus.cc:2454] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:42.621876 11569 raft_consensus.cc:2454] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:42.622316 11768 leader_election.cc:302] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 6529b03451c9475ab62c51f71714b0cf, 72cfad7451c64ef59a18e09d16a79046; no voters:
I20240502 20:45:42.622583 12725 raft_consensus.cc:2781] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:42.622741 12725 raft_consensus.cc:686] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Becoming Leader. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Running, Role: LEADER
I20240502 20:45:42.623167 12725 consensus_queue.cc:237] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } }
I20240502 20:45:42.625511 11425 catalog_manager.cc:5484] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } }
W20240502 20:45:42.769694 12760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:42.770011 12760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:42.773856 12760 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_2'
I20240502 20:45:42.855100 12696 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.876659 11569 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.877694 11963 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.878159 11700 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.878180 12796 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.878590 12224 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.879513 12796 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.879511 12725 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.880071 12795 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.882473 11700 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.886144 12224 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.886739 11962 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.886986 11569 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.887013 12804 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.887661 12804 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.888644 12724 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.890201 12725 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.891243 11700 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.891661 12725 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.893774 12223 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.894315 12094 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:42.894810 12724 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:42.895102 12724 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 20:45:42.986927 12029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.135:44285: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:45:42.987851 12029 consensus_peers.cc:485] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.135:44285: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
INSERT report
rows total: 2000
time total: 179.705 ms
time per row: 0.0898525 ms
I20240502 20:45:43.003628 11424 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57630:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:45:43.010123 11681 tablet_service.cc:1467] Processing CreateTablet for tablet 7261de9012914524a7c43551687fdc0b (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.010154 11942 tablet_service.cc:1467] Processing CreateTablet for tablet 7261de9012914524a7c43551687fdc0b (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.010515 11942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7261de9012914524a7c43551687fdc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.010519 11681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7261de9012914524a7c43551687fdc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.010793 11811 tablet_service.cc:1467] Processing CreateTablet for tablet 7261de9012914524a7c43551687fdc0b (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.011082 11811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7261de9012914524a7c43551687fdc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.012336 11810 tablet_service.cc:1467] Processing CreateTablet for tablet 1d55d69fcfb44cb29751908f32fb393f (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.012602 11810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d55d69fcfb44cb29751908f32fb393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.012650 12205 tablet_service.cc:1467] Processing CreateTablet for tablet 7261de9012914524a7c43551687fdc0b (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.012921 12205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7261de9012914524a7c43551687fdc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.013465 12850 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:43.014433 12850 tablet_bootstrap.cc:654] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.014462 11811 tablet_service.cc:1467] Processing CreateTablet for tablet f3be8e3350854d95922df01b9218a1d7 (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.014711 11811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3be8e3350854d95922df01b9218a1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.015043 11549 tablet_service.cc:1467] Processing CreateTablet for tablet f3be8e3350854d95922df01b9218a1d7 (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.015319 11549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3be8e3350854d95922df01b9218a1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.015539 11678 tablet_service.cc:1467] Processing CreateTablet for tablet 1d55d69fcfb44cb29751908f32fb393f (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.015880 11678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d55d69fcfb44cb29751908f32fb393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.016185 12850 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:43.016270 12850 ts_tablet_manager.cc:1367] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:43.016726 12850 raft_consensus.cc:348] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.016850 12850 raft_consensus.cc:374] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.016889 12850 raft_consensus.cc:729] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.017036 12850 consensus_queue.cc:260] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.017333 12850 ts_tablet_manager.cc:1398] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.017505 12850 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:43.018043 12853 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:43.018172 12851 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:43.018213 12204 tablet_service.cc:1467] Processing CreateTablet for tablet 1d55d69fcfb44cb29751908f32fb393f (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.018419 12850 tablet_bootstrap.cc:654] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.018491 12204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d55d69fcfb44cb29751908f32fb393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.018867 12853 tablet_bootstrap.cc:654] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.019066 12851 tablet_bootstrap.cc:654] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.020324 12850 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:43.020424 12850 ts_tablet_manager.cc:1367] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:43.020529 12072 tablet_service.cc:1467] Processing CreateTablet for tablet f3be8e3350854d95922df01b9218a1d7 (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.020819 12072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3be8e3350854d95922df01b9218a1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.020939 12850 raft_consensus.cc:348] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.021071 12850 raft_consensus.cc:374] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.021111 12850 raft_consensus.cc:729] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.021246 12850 consensus_queue.cc:260] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.021458 12851 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:43.021504 12853 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:43.021536 12850 ts_tablet_manager.cc:1398] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:43.021541 12851 ts_tablet_manager.cc:1367] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:43.021589 12853 ts_tablet_manager.cc:1367] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:45:43.021697 12850 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:43.022022 12851 raft_consensus.cc:348] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.022035 12853 raft_consensus.cc:348] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.022152 12851 raft_consensus.cc:374] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.022161 12853 raft_consensus.cc:374] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.022186 12851 raft_consensus.cc:729] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.022198 12853 raft_consensus.cc:729] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.022351 12851 consensus_queue.cc:260] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.022361 12853 consensus_queue.cc:260] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.022639 12850 tablet_bootstrap.cc:654] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.023360 12853 ts_tablet_manager.cc:1398] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:43.023342 12074 tablet_service.cc:1467] Processing CreateTablet for tablet 1d55d69fcfb44cb29751908f32fb393f (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.023599 12074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d55d69fcfb44cb29751908f32fb393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.024298 11680 tablet_service.cc:1467] Processing CreateTablet for tablet f3be8e3350854d95922df01b9218a1d7 (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.024627 11680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3be8e3350854d95922df01b9218a1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.024957 12073 tablet_service.cc:1467] Processing CreateTablet for tablet 7261de9012914524a7c43551687fdc0b (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.025192 12073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7261de9012914524a7c43551687fdc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.028147 11943 tablet_service.cc:1467] Processing CreateTablet for tablet 1d55d69fcfb44cb29751908f32fb393f (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.028436 11943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d55d69fcfb44cb29751908f32fb393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.028519 11941 tablet_service.cc:1467] Processing CreateTablet for tablet f3be8e3350854d95922df01b9218a1d7 (DEFAULT_TABLE table=rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.028815 11941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3be8e3350854d95922df01b9218a1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.029706 12859 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:43.029742 12849 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:43.030784 12859 tablet_bootstrap.cc:654] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.030855 12849 tablet_bootstrap.cc:654] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.031642 12857 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:43.032387 12851 ts_tablet_manager.cc:1398] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20240502 20:45:43.032631 12849 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:43.032685 12857 tablet_bootstrap.cc:654] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.032817 12849 ts_tablet_manager.cc:1367] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:43.033411 12849 raft_consensus.cc:348] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.033535 12851 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:43.033643 12849 raft_consensus.cc:374] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.033736 12849 raft_consensus.cc:729] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.034006 12849 consensus_queue.cc:260] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.034360 12850 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:43.034475 12850 ts_tablet_manager.cc:1367] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 20:45:43.034822 12851 tablet_bootstrap.cc:654] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.034946 12849 ts_tablet_manager.cc:1398] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:43.034958 12850 raft_consensus.cc:348] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.035079 12850 raft_consensus.cc:374] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.035120 12850 raft_consensus.cc:729] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.035241 12850 consensus_queue.cc:260] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.035462 12849 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:43.035566 12850 ts_tablet_manager.cc:1398] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.036638 12859 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:43.036758 12859 ts_tablet_manager.cc:1367] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 20:45:43.036856 12857 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:43.036936 12857 ts_tablet_manager.cc:1367] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20240502 20:45:43.037348 12859 raft_consensus.cc:348] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.037472 12859 raft_consensus.cc:374] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.037504 12859 raft_consensus.cc:729] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.037417 12857 raft_consensus.cc:348] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.037544 12857 raft_consensus.cc:374] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.037583 12857 raft_consensus.cc:729] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.037627 12859 consensus_queue.cc:260] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.037696 12857 consensus_queue.cc:260] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.037923 12859 ts_tablet_manager.cc:1398] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.037994 12857 ts_tablet_manager.cc:1398] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:43.038079 12859 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:43.038184 12857 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:43.039110 12859 tablet_bootstrap.cc:654] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.039331 12857 tablet_bootstrap.cc:654] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.040540 12857 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:43.040628 12857 ts_tablet_manager.cc:1367] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:43.040977 12849 tablet_bootstrap.cc:654] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.041082 12857 raft_consensus.cc:348] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.041234 12857 raft_consensus.cc:374] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.041270 12857 raft_consensus.cc:729] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.041410 12857 consensus_queue.cc:260] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.041711 12857 ts_tablet_manager.cc:1398] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.041961 12857 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:43.042171 12859 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:43.042289 12851 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:43.042325 12859 ts_tablet_manager.cc:1367] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:45:43.042403 12851 ts_tablet_manager.cc:1367] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 20:45:43.042928 12851 raft_consensus.cc:348] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.042943 12859 raft_consensus.cc:348] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.043063 12851 raft_consensus.cc:374] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.043103 12851 raft_consensus.cc:729] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.043174 12859 raft_consensus.cc:374] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.043273 12859 raft_consensus.cc:729] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.043231 12851 consensus_queue.cc:260] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.043540 12851 ts_tablet_manager.cc:1398] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:43.043530 12859 consensus_queue.cc:260] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.043884 12857 tablet_bootstrap.cc:654] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.044394 12849 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:43.044508 12849 ts_tablet_manager.cc:1367] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 20:45:43.044510 12859 ts_tablet_manager.cc:1398] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:43.044682 12859 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:43.045023 12849 raft_consensus.cc:348] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.045151 12849 raft_consensus.cc:374] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.045192 12849 raft_consensus.cc:729] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.045336 12849 consensus_queue.cc:260] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.045634 12849 ts_tablet_manager.cc:1398] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:43.045809 12849 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:43.046000 12859 tablet_bootstrap.cc:654] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.046739 12849 tablet_bootstrap.cc:654] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.047757 12859 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:43.047876 12859 ts_tablet_manager.cc:1367] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:43.048391 12849 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:43.048336 12859 raft_consensus.cc:348] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.048446 12859 raft_consensus.cc:374] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.048480 12859 raft_consensus.cc:729] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.048481 12849 ts_tablet_manager.cc:1367] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:43.048606 12859 consensus_queue.cc:260] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.048779 12857 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:43.048873 12857 ts_tablet_manager.cc:1367] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20240502 20:45:43.048924 12859 ts_tablet_manager.cc:1398] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.048930 12849 raft_consensus.cc:348] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.049047 12849 raft_consensus.cc:374] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.049079 12849 raft_consensus.cc:729] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.049194 12849 consensus_queue.cc:260] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.049472 12849 ts_tablet_manager.cc:1398] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:43.049890 12857 raft_consensus.cc:348] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.050112 12857 raft_consensus.cc:374] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.050194 12857 raft_consensus.cc:729] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.050432 12857 consensus_queue.cc:260] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.051182 12857 ts_tablet_manager.cc:1398] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:43.104161 12799 raft_consensus.cc:482] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:43.104341 12799 raft_consensus.cc:504] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.105676 12799 leader_election.cc:288] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:43.111294 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d55d69fcfb44cb29751908f32fb393f" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:43.111514 12094 raft_consensus.cc:2454] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 0.
I20240502 20:45:43.111701 11962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d55d69fcfb44cb29751908f32fb393f" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:43.111886 11962 raft_consensus.cc:2454] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 0.
I20240502 20:45:43.111874 12223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d55d69fcfb44cb29751908f32fb393f" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:43.112095 12223 raft_consensus.cc:2454] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 0.
I20240502 20:45:43.112186 11637 leader_election.cc:302] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 6529b03451c9475ab62c51f71714b0cf, 7dd8e38181f24e349fb179d2a9eb74c1, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:43.112546 12799 raft_consensus.cc:2781] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:43.112617 12799 raft_consensus.cc:482] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:43.112654 12799 raft_consensus.cc:3037] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.113050 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d55d69fcfb44cb29751908f32fb393f" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:43.113205 11832 raft_consensus.cc:2454] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 0.
I20240502 20:45:43.113876 12799 raft_consensus.cc:504] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.114356 12799 leader_election.cc:288] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [CANDIDATE]: Term 1 election: Requested vote from peers 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:43.114718 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d55d69fcfb44cb29751908f32fb393f" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3"
I20240502 20:45:43.114761 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d55d69fcfb44cb29751908f32fb393f" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
I20240502 20:45:43.114758 12223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d55d69fcfb44cb29751908f32fb393f" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:43.114820 11962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d55d69fcfb44cb29751908f32fb393f" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:43.114848 11832 raft_consensus.cc:3037] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.114869 12094 raft_consensus.cc:3037] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.114890 12223 raft_consensus.cc:3037] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.114925 11962 raft_consensus.cc:3037] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.115865 11832 raft_consensus.cc:2454] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 1.
I20240502 20:45:43.115865 12094 raft_consensus.cc:2454] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 1.
I20240502 20:45:43.115963 12223 raft_consensus.cc:2454] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 1.
I20240502 20:45:43.115998 11962 raft_consensus.cc:2454] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 1.
I20240502 20:45:43.116329 11635 leader_election.cc:302] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 6529b03451c9475ab62c51f71714b0cf, 72cfad7451c64ef59a18e09d16a79046, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:43.116631 12799 raft_consensus.cc:2781] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:43.116751 12799 raft_consensus.cc:686] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Running, Role: LEADER
I20240502 20:45:43.117079 12799 consensus_queue.cc:237] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.119936 11421 catalog_manager.cc:5484] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:43.122627 12689 raft_consensus.cc:482] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:43.122750 12689 raft_consensus.cc:504] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.123277 12689 leader_election.cc:288] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:43.123715 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7261de9012914524a7c43551687fdc0b" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:43.123904 11832 raft_consensus.cc:2454] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 0.
I20240502 20:45:43.123901 12223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7261de9012914524a7c43551687fdc0b" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:43.124069 12223 raft_consensus.cc:2454] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 0.
I20240502 20:45:43.124281 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7261de9012914524a7c43551687fdc0b" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:43.124449 12094 raft_consensus.cc:2454] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 0.
I20240502 20:45:43.124425 11897 leader_election.cc:302] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 6529b03451c9475ab62c51f71714b0cf, 72cfad7451c64ef59a18e09d16a79046; no voters:
I20240502 20:45:43.124617 12689 raft_consensus.cc:2781] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:43.124679 12689 raft_consensus.cc:482] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:43.124732 12689 raft_consensus.cc:3037] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.124963 11699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7261de9012914524a7c43551687fdc0b" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:43.125080 11699 raft_consensus.cc:2454] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 0.
I20240502 20:45:43.125638 12689 raft_consensus.cc:504] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.126073 12689 leader_election.cc:288] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 election: Requested vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:43.126366 11699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7261de9012914524a7c43551687fdc0b" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:43.126436 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7261de9012914524a7c43551687fdc0b" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3"
I20240502 20:45:43.126488 11699 raft_consensus.cc:3037] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.126585 11832 raft_consensus.cc:3037] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.126772 12223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7261de9012914524a7c43551687fdc0b" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:43.126904 12223 raft_consensus.cc:3037] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.127418 11699 raft_consensus.cc:2454] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 1.
I20240502 20:45:43.127666 11832 raft_consensus.cc:2454] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 1.
I20240502 20:45:43.127997 11897 leader_election.cc:302] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 6529b03451c9475ab62c51f71714b0cf, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:43.128003 12223 raft_consensus.cc:2454] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 1.
I20240502 20:45:43.128006 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7261de9012914524a7c43551687fdc0b" candidate_uuid: "6529b03451c9475ab62c51f71714b0cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
I20240502 20:45:43.128126 12094 raft_consensus.cc:3037] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.128162 12689 raft_consensus.cc:2781] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:43.128234 12689 raft_consensus.cc:686] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Becoming Leader. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Running, Role: LEADER
I20240502 20:45:43.128394 12689 consensus_queue.cc:237] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } }
I20240502 20:45:43.128890 12094 raft_consensus.cc:2454] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6529b03451c9475ab62c51f71714b0cf in term 1.
I20240502 20:45:43.130847 11421 catalog_manager.cc:5484] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 6529b03451c9475ab62c51f71714b0cf (127.9.82.132). New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:43.271544 12804 raft_consensus.cc:482] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:43.271690 12804 raft_consensus.cc:504] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.272169 12804 leader_election.cc:288] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:43.272644 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3be8e3350854d95922df01b9218a1d7" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:43.272644 11699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3be8e3350854d95922df01b9218a1d7" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:43.272709 11962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3be8e3350854d95922df01b9218a1d7" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:43.272723 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3be8e3350854d95922df01b9218a1d7" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:43.272795 11699 raft_consensus.cc:2454] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:43.272795 11570 raft_consensus.cc:2454] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:43.272861 12094 raft_consensus.cc:2454] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:43.272861 11962 raft_consensus.cc:2454] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 0.
I20240502 20:45:43.273181 11768 leader_election.cc:302] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 6529b03451c9475ab62c51f71714b0cf, 7dd8e38181f24e349fb179d2a9eb74c1; no voters:
I20240502 20:45:43.273389 12804 raft_consensus.cc:2781] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:43.273454 12804 raft_consensus.cc:482] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:43.273509 12804 raft_consensus.cc:3037] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.274441 12804 raft_consensus.cc:504] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.274858 12804 leader_election.cc:288] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Requested vote from peers 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:43.275262 11699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3be8e3350854d95922df01b9218a1d7" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:43.275372 11962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3be8e3350854d95922df01b9218a1d7" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:43.275439 11699 raft_consensus.cc:3037] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.275456 12094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3be8e3350854d95922df01b9218a1d7" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
I20240502 20:45:43.275463 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3be8e3350854d95922df01b9218a1d7" candidate_uuid: "07fe14e7347a4682bd8f6026ad776da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:43.275575 12094 raft_consensus.cc:3037] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.275579 11570 raft_consensus.cc:3037] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.275501 11962 raft_consensus.cc:3037] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.276556 11570 raft_consensus.cc:2454] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:43.276556 11699 raft_consensus.cc:2454] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:43.276600 12094 raft_consensus.cc:2454] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:43.276794 11962 raft_consensus.cc:2454] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07fe14e7347a4682bd8f6026ad776da3 in term 1.
I20240502 20:45:43.276950 11768 leader_election.cc:302] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 5521e131639043f8b116f9c71cf4bfee, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:43.277140 12804 raft_consensus.cc:2781] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:43.277269 12804 raft_consensus.cc:686] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Becoming Leader. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Running, Role: LEADER
I20240502 20:45:43.277433 12804 consensus_queue.cc:237] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } }
I20240502 20:45:43.279516 11421 catalog_manager.cc:5484] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } }
W20240502 20:45:43.429147 12879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:43.429423 12879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:43.432729 12879 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_3'
I20240502 20:45:43.514441 12799 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.518671 12799 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.521723 12223 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:43.522325 12815 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.523389 12093 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:43.524636 11699 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:43.528219 12799 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.528208 12689 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.528681 12689 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.528717 12225 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:43.528916 12689 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.530012 12799 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.532359 11570 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:43.532806 12724 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.533252 11699 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:43.533723 12724 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.533993 11963 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:43.534569 12092 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:43.535571 12724 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:43.539453 12724 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 172.622 ms
time per row: 0.0863112 ms
I20240502 20:45:43.652649 11421 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57630:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:45:43.659150 12204 tablet_service.cc:1467] Processing CreateTablet for tablet c3a361785bd34a5092f09a53c14ccddd (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.659286 11941 tablet_service.cc:1467] Processing CreateTablet for tablet c3a361785bd34a5092f09a53c14ccddd (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.659533 11941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a361785bd34a5092f09a53c14ccddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.659530 12204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a361785bd34a5092f09a53c14ccddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.660252 11810 tablet_service.cc:1467] Processing CreateTablet for tablet 897d8b67ce50427885a7ff494d509b13 (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.660252 11811 tablet_service.cc:1467] Processing CreateTablet for tablet c3a361785bd34a5092f09a53c14ccddd (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.660606 11811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a361785bd34a5092f09a53c14ccddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.662011 12205 tablet_service.cc:1467] Processing CreateTablet for tablet 897d8b67ce50427885a7ff494d509b13 (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.662026 12966 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:43.662251 12205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897d8b67ce50427885a7ff494d509b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.663007 12968 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:43.663075 12966 tablet_bootstrap.cc:654] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.663168 11810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897d8b67ce50427885a7ff494d509b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.663895 12968 tablet_bootstrap.cc:654] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.664294 11549 tablet_service.cc:1467] Processing CreateTablet for tablet c3a361785bd34a5092f09a53c14ccddd (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.664587 11549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a361785bd34a5092f09a53c14ccddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.664822 12968 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:43.664887 12968 ts_tablet_manager.cc:1367] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:43.665237 12968 raft_consensus.cc:348] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.665367 12968 raft_consensus.cc:374] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.665396 12968 raft_consensus.cc:729] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.665517 12968 consensus_queue.cc:260] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.665822 12967 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:43.666225 12968 ts_tablet_manager.cc:1398] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.666386 12968 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3: Bootstrap starting.
I20240502 20:45:43.666962 12967 tablet_bootstrap.cc:654] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.667276 12968 tablet_bootstrap.cc:654] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.668210 11680 tablet_service.cc:1467] Processing CreateTablet for tablet c3a361785bd34a5092f09a53c14ccddd (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.668560 11680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3a361785bd34a5092f09a53c14ccddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.668589 12205 tablet_service.cc:1467] Processing CreateTablet for tablet 95c74a872c72447cbf6c77beecf8bf1c (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.668731 11549 tablet_service.cc:1467] Processing CreateTablet for tablet 897d8b67ce50427885a7ff494d509b13 (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.668862 12205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c74a872c72447cbf6c77beecf8bf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.668985 11549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897d8b67ce50427885a7ff494d509b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.669157 11941 tablet_service.cc:1467] Processing CreateTablet for tablet 95c74a872c72447cbf6c77beecf8bf1c (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.669431 11941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c74a872c72447cbf6c77beecf8bf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.671195 12073 tablet_service.cc:1467] Processing CreateTablet for tablet 897d8b67ce50427885a7ff494d509b13 (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.671458 12073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897d8b67ce50427885a7ff494d509b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.672026 11678 tablet_service.cc:1467] Processing CreateTablet for tablet 95c74a872c72447cbf6c77beecf8bf1c (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.672289 11678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c74a872c72447cbf6c77beecf8bf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.672257 11548 tablet_service.cc:1467] Processing CreateTablet for tablet 95c74a872c72447cbf6c77beecf8bf1c (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.672500 12966 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:43.672601 12966 ts_tablet_manager.cc:1367] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 20:45:43.672614 11548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c74a872c72447cbf6c77beecf8bf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.673099 12966 raft_consensus.cc:348] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.673226 12966 raft_consensus.cc:374] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.673278 12966 raft_consensus.cc:729] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.673430 12966 consensus_queue.cc:260] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.673748 12966 ts_tablet_manager.cc:1398] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:45:43.673933 12966 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:43.674407 12975 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:43.675062 12966 tablet_bootstrap.cc:654] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.675196 11680 tablet_service.cc:1467] Processing CreateTablet for tablet 897d8b67ce50427885a7ff494d509b13 (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.675383 12975 tablet_bootstrap.cc:654] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.675491 11680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897d8b67ce50427885a7ff494d509b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.675818 12073 tablet_service.cc:1467] Processing CreateTablet for tablet 95c74a872c72447cbf6c77beecf8bf1c (DEFAULT_TABLE table=rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:45:43.676081 12073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c74a872c72447cbf6c77beecf8bf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:43.677326 12968 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3: No bootstrap required, opened a new log
I20240502 20:45:43.677428 12968 ts_tablet_manager.cc:1367] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 20:45:43.677951 12968 raft_consensus.cc:348] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.678076 12968 raft_consensus.cc:374] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.678108 12968 raft_consensus.cc:729] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07fe14e7347a4682bd8f6026ad776da3, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.678252 12968 consensus_queue.cc:260] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.678571 12968 ts_tablet_manager.cc:1398] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:45:43.680167 12971 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:43.681337 12971 tablet_bootstrap.cc:654] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.681690 12975 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:43.681831 12975 ts_tablet_manager.cc:1367] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 20:45:43.682139 12974 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:43.682278 12975 raft_consensus.cc:348] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.682384 12975 raft_consensus.cc:374] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.682417 12975 raft_consensus.cc:729] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.682564 12971 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:43.682564 12975 consensus_queue.cc:260] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.682653 12971 ts_tablet_manager.cc:1367] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:43.682850 12975 ts_tablet_manager.cc:1398] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.682974 12975 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1: Bootstrap starting.
I20240502 20:45:43.683146 12974 tablet_bootstrap.cc:654] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.683662 12971 raft_consensus.cc:348] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.683876 12971 raft_consensus.cc:374] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.683974 12971 raft_consensus.cc:729] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.684697 12967 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:43.684712 12975 tablet_bootstrap.cc:654] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.684893 12967 ts_tablet_manager.cc:1367] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20240502 20:45:43.685451 12967 raft_consensus.cc:348] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.685590 12967 raft_consensus.cc:374] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.685667 12967 raft_consensus.cc:729] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.685866 12967 consensus_queue.cc:260] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.686007 12975 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1: No bootstrap required, opened a new log
I20240502 20:45:43.686178 12975 ts_tablet_manager.cc:1367] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:45:43.686295 12971 consensus_queue.cc:260] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.686663 12971 ts_tablet_manager.cc:1398] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:45:43.686836 12975 raft_consensus.cc:348] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.686928 12967 ts_tablet_manager.cc:1398] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:43.687037 12975 raft_consensus.cc:374] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.687074 12967 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf: Bootstrap starting.
I20240502 20:45:43.687135 12975 raft_consensus.cc:729] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dd8e38181f24e349fb179d2a9eb74c1, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.687326 12975 consensus_queue.cc:260] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.687618 12971 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:43.687788 12975 ts_tablet_manager.cc:1398] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:45:43.688028 12967 tablet_bootstrap.cc:654] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.688692 12971 tablet_bootstrap.cc:654] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.689453 12967 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf: No bootstrap required, opened a new log
I20240502 20:45:43.689541 12967 ts_tablet_manager.cc:1367] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:45:43.689824 12974 tablet_bootstrap.cc:492] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:43.689989 12967 raft_consensus.cc:348] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.690122 12967 raft_consensus.cc:374] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.690153 12967 raft_consensus.cc:729] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6529b03451c9475ab62c51f71714b0cf, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.690261 12967 consensus_queue.cc:260] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.690541 12967 ts_tablet_manager.cc:1398] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:43.690678 12974 ts_tablet_manager.cc:1367] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 20:45:43.691272 12974 raft_consensus.cc:348] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.691408 12974 raft_consensus.cc:374] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.691454 12974 raft_consensus.cc:729] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.691591 12974 consensus_queue.cc:260] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.691874 12974 ts_tablet_manager.cc:1398] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.692060 12974 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:43.692850 12974 tablet_bootstrap.cc:654] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.693778 12974 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:43.693876 12974 ts_tablet_manager.cc:1367] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:43.694219 12974 raft_consensus.cc:348] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.694308 12974 raft_consensus.cc:374] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.694340 12974 raft_consensus.cc:729] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.694442 12974 consensus_queue.cc:260] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.694726 12974 ts_tablet_manager.cc:1398] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.694881 12974 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:43.695633 12974 tablet_bootstrap.cc:654] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.696374 12971 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:43.696528 12971 ts_tablet_manager.cc:1367] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 20:45:43.696702 12974 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7: No bootstrap required, opened a new log
I20240502 20:45:43.696782 12974 ts_tablet_manager.cc:1367] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:43.697023 12971 raft_consensus.cc:348] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.697134 12971 raft_consensus.cc:374] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.697173 12971 raft_consensus.cc:729] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.697149 12974 raft_consensus.cc:348] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.697275 12974 raft_consensus.cc:374] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.697309 12974 raft_consensus.cc:729] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.697326 12971 consensus_queue.cc:260] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.697463 12974 consensus_queue.cc:260] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.697623 12971 ts_tablet_manager.cc:1398] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.697717 12974 ts_tablet_manager.cc:1398] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:43.697839 12971 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:43.698904 12971 tablet_bootstrap.cc:654] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.712108 12966 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:43.712224 12966 ts_tablet_manager.cc:1367] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20240502 20:45:43.712666 12966 raft_consensus.cc:348] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.712780 12966 raft_consensus.cc:374] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.712801 12966 raft_consensus.cc:729] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.712930 12966 consensus_queue.cc:260] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.713193 12966 ts_tablet_manager.cc:1398] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:45:43.713388 12966 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
I20240502 20:45:43.714398 12966 tablet_bootstrap.cc:654] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046: Neither blocks nor log segments found. Creating new log.
I20240502 20:45:43.715653 12966 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046: No bootstrap required, opened a new log
I20240502 20:45:43.715770 12966 ts_tablet_manager.cc:1367] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:43.716203 12966 raft_consensus.cc:348] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.716339 12966 raft_consensus.cc:374] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.716423 12966 raft_consensus.cc:729] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.716553 12966 consensus_queue.cc:260] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.716841 12966 ts_tablet_manager.cc:1398] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:43.718539 12819 raft_consensus.cc:482] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:43.718637 12819 raft_consensus.cc:504] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.719302 12819 leader_election.cc:288] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991)
I20240502 20:45:43.719616 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a361785bd34a5092f09a53c14ccddd" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:43.719799 11570 raft_consensus.cc:2454] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:43.720458 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a361785bd34a5092f09a53c14ccddd" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:43.720605 11832 raft_consensus.cc:2454] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:43.720960 12159 leader_election.cc:302] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 5521e131639043f8b116f9c71cf4bfee, 72cfad7451c64ef59a18e09d16a79046; no voters:
I20240502 20:45:43.721132 12819 raft_consensus.cc:2781] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:43.721076 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a361785bd34a5092f09a53c14ccddd" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:43.721175 12819 raft_consensus.cc:482] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:43.721210 12819 raft_consensus.cc:3037] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.721247 11700 raft_consensus.cc:2454] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:43.722306 12819 raft_consensus.cc:504] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.722769 12819 leader_election.cc:288] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 election: Requested vote from peers 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991)
I20240502 20:45:43.722988 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a361785bd34a5092f09a53c14ccddd" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3"
I20240502 20:45:43.723112 11832 raft_consensus.cc:3037] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.723371 11963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a361785bd34a5092f09a53c14ccddd" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:43.723435 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a361785bd34a5092f09a53c14ccddd" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:43.723520 11963 raft_consensus.cc:2454] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:43.723541 11700 raft_consensus.cc:3037] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.723570 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a361785bd34a5092f09a53c14ccddd" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:43.723685 11570 raft_consensus.cc:3037] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.724120 12971 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee: No bootstrap required, opened a new log
I20240502 20:45:43.724217 12971 ts_tablet_manager.cc:1367] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20240502 20:45:43.724210 11832 raft_consensus.cc:2454] T c3a361785bd34a5092f09a53c14ccddd P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:43.724614 11700 raft_consensus.cc:2454] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:43.724730 11570 raft_consensus.cc:2454] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:43.724906 12161 leader_election.cc:302] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 72cfad7451c64ef59a18e09d16a79046, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:43.724964 12971 raft_consensus.cc:348] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.723414 11962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3a361785bd34a5092f09a53c14ccddd" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:43.725064 12971 raft_consensus.cc:374] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:45:43.725073 12819 raft_consensus.cc:2781] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:43.725098 12971 raft_consensus.cc:729] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: FOLLOWER
I20240502 20:45:43.725142 11962 raft_consensus.cc:3037] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.725244 12819 raft_consensus.cc:686] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEADER]: Becoming Leader. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Running, Role: LEADER
I20240502 20:45:43.725251 12971 consensus_queue.cc:260] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.725382 12819 consensus_queue.cc:237] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.726107 12971 ts_tablet_manager.cc:1398] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:43.726094 11962 raft_consensus.cc:2454] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:43.728199 11421 catalog_manager.cc:5484] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134). New cstate: current_term: 1 leader_uuid: "72cfad7451c64ef59a18e09d16a79046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:43.801609 12988 raft_consensus.cc:482] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:43.801748 12988 raft_consensus.cc:504] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.802302 12988 leader_election.cc:288] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991)
I20240502 20:45:43.802645 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c74a872c72447cbf6c77beecf8bf1c" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:43.802747 11962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c74a872c72447cbf6c77beecf8bf1c" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf" is_pre_election: true
I20240502 20:45:43.802803 11570 raft_consensus.cc:2454] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:43.802820 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c74a872c72447cbf6c77beecf8bf1c" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7" is_pre_election: true
I20240502 20:45:43.802883 11962 raft_consensus.cc:2454] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:43.802956 11700 raft_consensus.cc:2454] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:43.803310 12161 leader_election.cc:302] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 5521e131639043f8b116f9c71cf4bfee, 72cfad7451c64ef59a18e09d16a79046, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:43.803339 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c74a872c72447cbf6c77beecf8bf1c" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:43.803463 12093 raft_consensus.cc:2454] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 0.
I20240502 20:45:43.803540 12988 raft_consensus.cc:2781] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:43.803598 12988 raft_consensus.cc:482] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:43.803637 12988 raft_consensus.cc:3037] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.804698 12988 raft_consensus.cc:504] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.805128 12988 leader_election.cc:288] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 election: Requested vote from peers 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991)
I20240502 20:45:43.805388 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c74a872c72447cbf6c77beecf8bf1c" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:43.805461 11962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c74a872c72447cbf6c77beecf8bf1c" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6529b03451c9475ab62c51f71714b0cf"
I20240502 20:45:43.805508 11570 raft_consensus.cc:3037] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.805559 11962 raft_consensus.cc:3037] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.805596 11700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c74a872c72447cbf6c77beecf8bf1c" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8096a2fe270b492baa3178ad9d2976e7"
I20240502 20:45:43.805704 11700 raft_consensus.cc:3037] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.806468 11962 raft_consensus.cc:2454] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:43.806495 11570 raft_consensus.cc:2454] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:43.806677 11700 raft_consensus.cc:2454] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:43.807134 12161 leader_election.cc:302] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 5521e131639043f8b116f9c71cf4bfee, 72cfad7451c64ef59a18e09d16a79046, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:43.807125 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c74a872c72447cbf6c77beecf8bf1c" candidate_uuid: "72cfad7451c64ef59a18e09d16a79046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
I20240502 20:45:43.807236 12093 raft_consensus.cc:3037] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.807296 12988 raft_consensus.cc:2781] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:43.807420 12988 raft_consensus.cc:686] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEADER]: Becoming Leader. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Running, Role: LEADER
I20240502 20:45:43.807577 12988 consensus_queue.cc:237] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } }
I20240502 20:45:43.808295 12093 raft_consensus.cc:2454] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72cfad7451c64ef59a18e09d16a79046 in term 1.
I20240502 20:45:43.810117 11421 catalog_manager.cc:5484] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134). New cstate: current_term: 1 leader_uuid: "72cfad7451c64ef59a18e09d16a79046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:43.886318 12940 raft_consensus.cc:482] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:45:43.886464 12940 raft_consensus.cc:504] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.887159 12940 leader_election.cc:288] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:43.887512 12223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897d8b67ce50427885a7ff494d509b13" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046" is_pre_election: true
I20240502 20:45:43.887562 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897d8b67ce50427885a7ff494d509b13" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3" is_pre_election: true
I20240502 20:45:43.887678 11832 raft_consensus.cc:2454] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 0.
I20240502 20:45:43.887676 12223 raft_consensus.cc:2454] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 0.
I20240502 20:45:43.887861 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897d8b67ce50427885a7ff494d509b13" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" is_pre_election: true
I20240502 20:45:43.888011 12093 raft_consensus.cc:2454] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 0.
I20240502 20:45:43.888069 11635 leader_election.cc:302] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 72cfad7451c64ef59a18e09d16a79046, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:43.888254 12940 raft_consensus.cc:2781] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:45:43.888324 12940 raft_consensus.cc:482] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:45:43.888374 12940 raft_consensus.cc:3037] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.889688 12940 raft_consensus.cc:504] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.890172 12940 leader_election.cc:288] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [CANDIDATE]: Term 1 election: Requested vote from peers 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241), 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233), 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161), 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:43.890555 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897d8b67ce50427885a7ff494d509b13" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dd8e38181f24e349fb179d2a9eb74c1"
I20240502 20:45:43.890554 12223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897d8b67ce50427885a7ff494d509b13" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72cfad7451c64ef59a18e09d16a79046"
I20240502 20:45:43.890566 11832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897d8b67ce50427885a7ff494d509b13" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07fe14e7347a4682bd8f6026ad776da3"
I20240502 20:45:43.890686 11832 raft_consensus.cc:3037] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.890687 12093 raft_consensus.cc:3037] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.890687 12223 raft_consensus.cc:3037] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:43.891669 12223 raft_consensus.cc:2454] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 1.
I20240502 20:45:43.891669 12093 raft_consensus.cc:2454] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 1.
I20240502 20:45:43.891702 11832 raft_consensus.cc:2454] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 1.
I20240502 20:45:43.892040 11637 leader_election.cc:302] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 07fe14e7347a4682bd8f6026ad776da3, 7dd8e38181f24e349fb179d2a9eb74c1, 8096a2fe270b492baa3178ad9d2976e7; no voters:
I20240502 20:45:43.892272 12940 raft_consensus.cc:2781] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:45:43.892369 12940 raft_consensus.cc:686] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Becoming Leader. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Running, Role: LEADER
I20240502 20:45:43.892527 11570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897d8b67ce50427885a7ff494d509b13" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee" is_pre_election: true
I20240502 20:45:43.892526 12940 consensus_queue.cc:237] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:43.892603 11569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897d8b67ce50427885a7ff494d509b13" candidate_uuid: "8096a2fe270b492baa3178ad9d2976e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5521e131639043f8b116f9c71cf4bfee"
I20240502 20:45:43.892678 11570 raft_consensus.cc:2454] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8096a2fe270b492baa3178ad9d2976e7 in term 0.
I20240502 20:45:43.894596 11421 catalog_manager.cc:5484] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } }
W20240502 20:45:44.032721 12995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:44.033046 12995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:44.036500 12995 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_4'
I20240502 20:45:44.102414 12988 consensus_queue.cc:1035] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.124779 11569 raft_consensus.cc:3037] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:45:44.124826 11832 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.125598 11962 raft_consensus.cc:1261] T c3a361785bd34a5092f09a53c14ccddd P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.126121 11569 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.126580 12819 consensus_queue.cc:1035] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.127044 11700 raft_consensus.cc:1261] T c3a361785bd34a5092f09a53c14ccddd P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.127192 12799 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.127948 12819 consensus_queue.cc:1035] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.128379 12223 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.130959 12799 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.137105 12940 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.140070 12093 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.143608 11700 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.144049 11568 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.144138 12940 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.144501 12988 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.144901 12093 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.142863 13028 mvcc.cc:205] Tried to move back new op lower bound from 7023340519930343424 to 7023340518301184000. Current Snapshot: MvccSnapshot[applied={T|T < 7023340519930343424}]
I20240502 20:45:44.145807 13030 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.146112 13030 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.147821 11569 raft_consensus.cc:1261] T c3a361785bd34a5092f09a53c14ccddd P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.164271 13030 consensus_queue.cc:1035] T c3a361785bd34a5092f09a53c14ccddd P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.164557 11962 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:44.165434 13030 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:45:44.187127 13027 mvcc.cc:205] Tried to move back new op lower bound from 7023340519929819136 to 7023340518986014720. Current Snapshot: MvccSnapshot[applied={T|T < 7023340519929819136}]
I20240502 20:45:44.199869 13039 mvcc.cc:205] Tried to move back new op lower bound from 7023340520007008256 to 7023340518638391296. Current Snapshot: MvccSnapshot[applied={T|T < 7023340520007008256}]
INSERT report
rows total: 2000
time total: 166.702 ms
time per row: 0.083351 ms
I20240502 20:45:44.253029 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.135:44285
--local_ip_for_outbound_sockets=127.9.82.135
--tserver_master_addrs=127.9.82.190:43461
--webserver_port=38983
--webserver_interface=127.9.82.135
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:45:44.381347 13080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:45:44.381680 13080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:45:44.381745 13080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:45:44.386335 13080 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:45:44.386451 13080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:45:44.386557 13080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.135
I20240502 20:45:44.391961 13080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.135:44285
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.9.82.135
--webserver_port=38983
--tserver_master_addrs=127.9.82.190:43461
--never_fsync=true
--heap_profile_path=/tmp/kudu.13080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.135
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:45:44.393175 13080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:45:44.394552 13080 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:45:44.403862 13085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:44.404385 13086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:45:44.405488 13088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:45:44.406329 13080 server_base.cc:1034] running on GCE node
I20240502 20:45:44.406816 13080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:45:44.407460 13080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:45:44.408629 13080 hybrid_clock.cc:648] HybridClock initialized: now 1714682744408595 us; error 50 us; skew 500 ppm
I20240502 20:45:44.410912 13080 webserver.cc:460] Webserver started at http://127.9.82.135:38983/ using document root <none> and password file <none>
I20240502 20:45:44.411523 13080 fs_manager.cc:359] Metadata directory not provided
I20240502 20:45:44.411614 13080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:45:44.415280 13080 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:44.417569 13094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:45:44.418669 13080 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:45:44.418788 13080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "8824a7df8ec9431db37c0bb434ede060"
format_stamp: "Formatted at 2024-05-02 20:45:36 on dist-test-slave-2pss"
I20240502 20:45:44.419260 13080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:45:44.434914 13080 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:45:44.435614 13080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:45:44.435808 13080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:45:44.436371 13080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:45:44.437613 13101 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240502 20:45:44.441105 13080 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 20:45:44.441179 13080 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20240502 20:45:44.441253 13080 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 20:45:44.442775 13080 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 20:45:44.442823 13080 ts_tablet_manager.cc:569] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20240502 20:45:44.443117 13101 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:44.453830 13080 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.135:44285
I20240502 20:45:44.453889 13208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.135:44285 every 8 connection(s)
I20240502 20:45:44.454931 13080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 20:45:44.457723 13101 log.cc:824] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Log is configured to *not* fsync() on all Append() calls
I20240502 20:45:44.459689 13101 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:44.460062 13101 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:44.461139 13101 ts_tablet_manager.cc:1367] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.011s
I20240502 20:45:44.461381 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 13080
I20240502 20:45:44.461565 9546 test_util.cc:268] Using random seed: -1344087811
I20240502 20:45:44.464732 13101 raft_consensus.cc:348] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:44.465188 13101 raft_consensus.cc:729] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: FOLLOWER
I20240502 20:45:44.465759 13101 consensus_queue.cc:260] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } }
I20240502 20:45:44.465868 13209 heartbeater.cc:347] Connected to a master server at 127.9.82.190:43461
I20240502 20:45:44.466254 13209 heartbeater.cc:464] Registering TS with master...
I20240502 20:45:44.466766 13101 ts_tablet_manager.cc:1398] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20240502 20:45:44.466917 13209 heartbeater.cc:511] Master 127.9.82.190:43461 requested a full tablet report, sending...
I20240502 20:45:44.469040 11422 ts_manager.cc:194] Re-registered known tserver with Master: 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285)
I20240502 20:45:44.469918 11422 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.135:60055
I20240502 20:45:44.472460 13209 heartbeater.cc:503] Master 127.9.82.190:43461 was elected leader, sending a full tablet report...
I20240502 20:45:44.474242 9546 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_0 already exists
I20240502 20:45:44.474457 9546 test_util.cc:268] Using random seed: -1344074919
I20240502 20:45:44.485658 9546 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_1 already exists
I20240502 20:45:44.485849 9546 test_util.cc:268] Using random seed: -1344063530
I20240502 20:45:44.501981 9546 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_2 already exists
I20240502 20:45:44.502185 9546 test_util.cc:268] Using random seed: -1344047194
I20240502 20:45:44.538975 9546 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_3 already exists
I20240502 20:45:44.539153 9546 test_util.cc:268] Using random seed: -1344010225
I20240502 20:45:44.575182 9546 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_4 already exists
I20240502 20:45:45.275333 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:45.333029 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:45:45.367985 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:45:45.371989 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:45.413064 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:45:45.424587 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:45.541211 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:45:45.977174 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:45:46.052778 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:46.072330 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:46.087996 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:45:46.200937 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:46.214023 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:45:46.255905 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:45:46.745121 11962 consensus_queue.cc:237] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 1.47, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:46.747663 11832 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:46.748268 13443 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:46.755185 11700 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:46.755779 12917 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:46.757486 12222 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:46.768095 12917 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:46.773841 12094 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 45. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:46.780052 12917 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:46.783186 11830 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:46.784379 11422 catalog_manager.cc:5484] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:46.790910 11697 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:46.798621 12917 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 44, Time since last communication: 0.000s
I20240502 20:45:46.804347 11960 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:46.807947 11830 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20240502 20:45:46.808373 11568 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20240502 20:45:46.809502 12917 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20240502 20:45:46.809854 12917 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20240502 20:45:46.814318 13443 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index -1 to 30, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
W20240502 20:45:46.815030 12161 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 46211.5us
I20240502 20:45:46.817732 11830 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index -1 to 30, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:46.825616 12092 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20240502 20:45:46.825440 11565 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index -1 to 30, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:46.826073 13467 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 28, Time since last communication: 0.000s
I20240502 20:45:46.826108 12090 raft_consensus.cc:1203] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.45->[1.46-1.48] Dedup: 1.46->[1.47-1.48]
I20240502 20:45:46.827602 12090 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:46.829658 12225 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20240502 20:45:46.834264 12918 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 28, Time since last communication: 0.000s
I20240502 20:45:46.837081 11421 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index -1 to 30, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:46.841176 12092 raft_consensus.cc:1203] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.28->[1.29-1.31] Dedup: 1.29->[1.30-1.31]
I20240502 20:45:46.844384 12225 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index -1 to 30, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:46.845155 12092 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index -1 to 30, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:46.849442 12222 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
W20240502 20:45:46.880999 11898 consensus_peers.cc:485] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7261de9012914524a7c43551687fdc0b. This is attempt 1: this message will repeat every 5th retry.
W20240502 20:45:46.881217 11898 consensus_peers.cc:485] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a2169943b994152ba495bdb810754a0. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:47.059929 12093 consensus_queue.cc:237] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: true } }
I20240502 20:45:47.063709 13148 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:47.064469 12797 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 20:45:47.069975 11830 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:47.071244 12797 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 20:45:47.086900 11963 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:47.088528 11698 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:45:47.089581 13421 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 20:45:47.099152 13421 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240502 20:45:47.117939 12028 consensus_peers.cc:485] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241): Couldn't send request to peer 72cfad7451c64ef59a18e09d16a79046. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 959ee5415c0a44bbaf7bb3a1ba870902. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:47.139580 13484 ts_tablet_manager.cc:902] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493)
I20240502 20:45:47.140985 13484 tablet_copy_client.cc:308] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:35493
I20240502 20:45:47.163686 13420 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: true } } }
I20240502 20:45:47.166991 11421 catalog_manager.cc:5484] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:47.178470 11832 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: true } } }
I20240502 20:45:47.184244 11963 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: true } } }
I20240502 20:45:47.191577 13148 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: true } } }
I20240502 20:45:47.203176 11697 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: true } } }
I20240502 20:45:47.207844 13496 ts_tablet_manager.cc:902] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493)
I20240502 20:45:47.208578 13496 tablet_copy_client.cc:308] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:35493
I20240502 20:45:47.230979 11983 tablet_copy_service.cc:140] P 6529b03451c9475ab62c51f71714b0cf: Received BeginTabletCopySession request for tablet 7261de9012914524a7c43551687fdc0b from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:54591)
I20240502 20:45:47.231194 11983 tablet_copy_service.cc:161] P 6529b03451c9475ab62c51f71714b0cf: Beginning new tablet copy session on tablet 7261de9012914524a7c43551687fdc0b from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:54591: session id = 8824a7df8ec9431db37c0bb434ede060-7261de9012914524a7c43551687fdc0b
I20240502 20:45:47.231890 11982 tablet_copy_service.cc:140] P 6529b03451c9475ab62c51f71714b0cf: Received BeginTabletCopySession request for tablet 8a2169943b994152ba495bdb810754a0 from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:54591)
I20240502 20:45:47.231990 11982 tablet_copy_service.cc:161] P 6529b03451c9475ab62c51f71714b0cf: Beginning new tablet copy session on tablet 8a2169943b994152ba495bdb810754a0 from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:54591: session id = 8824a7df8ec9431db37c0bb434ede060-8a2169943b994152ba495bdb810754a0
I20240502 20:45:47.232473 11983 tablet_copy_source_session.cc:205] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:47.232836 11982 tablet_copy_source_session.cc:205] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:47.234826 13484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7261de9012914524a7c43551687fdc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:47.238663 13496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2169943b994152ba495bdb810754a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:47.240859 13496 tablet_copy_client.cc:783] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:47.241066 13496 tablet_copy_client.cc:647] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:47.241407 13484 tablet_copy_client.cc:783] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:47.241633 13484 tablet_copy_client.cc:647] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:47.245522 13484 tablet_copy_client.cc:523] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:47.247229 13484 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:47.253665 13496 tablet_copy_client.cc:523] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:47.258646 13496 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:47.384161 13496 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=35 overwritten=0 applied=35 ignored=0} inserts{seen=720 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:47.384630 13496 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:47.384963 13496 ts_tablet_manager.cc:1367] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.129s user 0.051s sys 0.000s
I20240502 20:45:47.385738 13496 raft_consensus.cc:348] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:47.386006 13496 raft_consensus.cc:729] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:47.386204 13496 consensus_queue.cc:260] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 35, Last appended: 1.35, Last appended by leader: 35, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:47.388609 13496 ts_tablet_manager.cc:1398] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:45:47.389940 12093 consensus_queue.cc:237] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:47.390843 11983 tablet_copy_service.cc:342] P 6529b03451c9475ab62c51f71714b0cf: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-8a2169943b994152ba495bdb810754a0 received from {username='slave'} at 127.9.82.135:54591
I20240502 20:45:47.390960 11983 tablet_copy_service.cc:433] P 6529b03451c9475ab62c51f71714b0cf: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-8a2169943b994152ba495bdb810754a0 on tablet 8a2169943b994152ba495bdb810754a0 with peer 8824a7df8ec9431db37c0bb434ede060
W20240502 20:45:47.392387 12029 consensus_peers.cc:485] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed4d27cc41454a108252941a99cd16e2. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:47.397632 13484 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=56 overwritten=0 applied=56 ignored=0} inserts{seen=741 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:47.398047 13484 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:47.398322 13484 ts_tablet_manager.cc:1367] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.151s user 0.066s sys 0.007s
I20240502 20:45:47.398731 11700 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20240502 20:45:47.398851 13484 raft_consensus.cc:348] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:47.399094 13484 raft_consensus.cc:729] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:47.399260 13484 consensus_queue.cc:260] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 56, Last appended: 1.56, Last appended by leader: 56, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:47.399432 11565 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20240502 20:45:47.400723 11960 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20240502 20:45:47.401878 13484 ts_tablet_manager.cc:1398] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:45:47.404054 11983 tablet_copy_service.cc:342] P 6529b03451c9475ab62c51f71714b0cf: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-7261de9012914524a7c43551687fdc0b received from {username='slave'} at 127.9.82.135:54591
I20240502 20:45:47.404140 11983 tablet_copy_service.cc:433] P 6529b03451c9475ab62c51f71714b0cf: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-7261de9012914524a7c43551687fdc0b on tablet 7261de9012914524a7c43551687fdc0b with peer 8824a7df8ec9431db37c0bb434ede060
I20240502 20:45:47.405084 13421 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20240502 20:45:47.409400 12222 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20240502 20:45:47.409857 13273 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20240502 20:45:47.416661 13421 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20240502 20:45:47.419631 13421 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20240502 20:45:47.494242 13420 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.498893 11421 catalog_manager.cc:5484] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index -1 to 33, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:47.502357 11961 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.506243 11566 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.509282 11697 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.515481 12221 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.553752 13511 ts_tablet_manager.cc:902] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: Initiating tablet copy from peer 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:47.554574 13511 tablet_copy_client.cc:308] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:33233
I20240502 20:45:47.555289 12114 tablet_copy_service.cc:140] P 7dd8e38181f24e349fb179d2a9eb74c1: Received BeginTabletCopySession request for tablet 959ee5415c0a44bbaf7bb3a1ba870902 from peer 72cfad7451c64ef59a18e09d16a79046 ({username='slave'} at 127.9.82.134:40939)
I20240502 20:45:47.555464 12114 tablet_copy_service.cc:161] P 7dd8e38181f24e349fb179d2a9eb74c1: Beginning new tablet copy session on tablet 959ee5415c0a44bbaf7bb3a1ba870902 from peer 72cfad7451c64ef59a18e09d16a79046 at {username='slave'} at 127.9.82.134:40939: session id = 72cfad7451c64ef59a18e09d16a79046-959ee5415c0a44bbaf7bb3a1ba870902
I20240502 20:45:47.557083 12114 tablet_copy_source_session.cc:205] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:47.558737 11700 consensus_queue.cc:237] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 1.46, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:47.561508 13511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 959ee5415c0a44bbaf7bb3a1ba870902. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:47.562328 11960 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 20:45:47.562736 13301 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:47.563903 12221 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 20:45:47.564757 13301 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:47.566169 13511 tablet_copy_client.cc:783] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:47.566398 13511 tablet_copy_client.cc:647] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:47.566782 13447 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.47: config changed from index -1 to 47, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.569321 13511 tablet_copy_client.cc:523] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:47.569476 12094 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 20:45:47.569866 13301 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:47.570947 12093 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index -1 to 47, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.574218 11829 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 20:45:47.574334 11419 catalog_manager.cc:5484] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index -1 to 47, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.574843 13301 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:47.576087 11829 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index -1 to 47, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.576663 12223 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index -1 to 47, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.579324 11960 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index -1 to 47, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.582406 13511 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap starting.
W20240502 20:45:47.587762 11636 consensus_peers.cc:485] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d55d69fcfb44cb29751908f32fb393f. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:47.628201 13148 raft_consensus.cc:1203] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.47->[1.48-1.60] Dedup: 1.56->[1.57-1.60]
I20240502 20:45:47.729743 12917 raft_consensus.cc:1050] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:47.732995 11829 consensus_queue.cc:237] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 38, Committed index: 38, Last appended: 1.38, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:47.738896 13511 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:47.738999 12917 consensus_queue.cc:237] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 1.61, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 62 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:47.739287 13511 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: Bootstrap complete.
I20240502 20:45:47.739562 13511 ts_tablet_manager.cc:1367] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: Time spent bootstrapping tablet: real 0.157s user 0.000s sys 0.006s
I20240502 20:45:47.742089 13148 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 61. Preceding OpId from leader: term: 1 index: 62. (index mismatch)
I20240502 20:45:47.742173 11700 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 60. Preceding OpId from leader: term: 1 index: 62. (index mismatch)
I20240502 20:45:47.744078 13443 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 60, Time since last communication: 0.000s
I20240502 20:45:47.745272 13443 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 60, Time since last communication: 0.000s
I20240502 20:45:47.745314 13511 raft_consensus.cc:348] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: true } }
I20240502 20:45:47.745453 13511 raft_consensus.cc:729] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72cfad7451c64ef59a18e09d16a79046, State: Initialized, Role: LEARNER
I20240502 20:45:47.745582 13511 consensus_queue.cc:260] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: true } }
I20240502 20:45:47.745924 13511 ts_tablet_manager.cc:1398] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20240502 20:45:47.747045 12222 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 61. Preceding OpId from leader: term: 1 index: 62. (index mismatch)
I20240502 20:45:47.749711 12114 tablet_copy_service.cc:342] P 7dd8e38181f24e349fb179d2a9eb74c1: Request end of tablet copy session 72cfad7451c64ef59a18e09d16a79046-959ee5415c0a44bbaf7bb3a1ba870902 received from {username='slave'} at 127.9.82.134:40939
I20240502 20:45:47.749820 12114 tablet_copy_service.cc:433] P 7dd8e38181f24e349fb179d2a9eb74c1: ending tablet copy session 72cfad7451c64ef59a18e09d16a79046-959ee5415c0a44bbaf7bb3a1ba870902 on tablet 959ee5415c0a44bbaf7bb3a1ba870902 with peer 72cfad7451c64ef59a18e09d16a79046
I20240502 20:45:47.750860 13443 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 60, Time since last communication: 0.000s
I20240502 20:45:47.751441 11830 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 61. Preceding OpId from leader: term: 1 index: 62. (index mismatch)
I20240502 20:45:47.752357 13443 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 60, Time since last communication: 0.000s
I20240502 20:45:47.754262 11697 raft_consensus.cc:1203] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.60->[1.61-1.61] Dedup: 1.61->[]
I20240502 20:45:47.754329 13467 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.62: config changed from index 48 to 62, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 62 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.755450 11830 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.62: config changed from index 48 to 62, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 62 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.756696 11697 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.62: config changed from index 48 to 62, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 62 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.757259 13148 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.62: config changed from index 48 to 62, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 62 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.759976 11421 catalog_manager.cc:5484] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index 48 to 62, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 62 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.764936 11962 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 38. Preceding OpId from leader: term: 1 index: 39. (index mismatch)
I20240502 20:45:47.769330 12225 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.62: config changed from index 48 to 62, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 62 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.772430 12221 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 38. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20240502 20:45:47.773490 13533 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 39, Last known committed idx: 38, Time since last communication: 0.000s
W20240502 20:45:47.796005 11767 consensus_peers.cc:485] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2bbffeb3e45e4ab78112632675d55ac6. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:47.810221 13148 raft_consensus.cc:1203] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.29->[1.30-1.38] Dedup: 1.35->[1.36-1.38]
I20240502 20:45:47.821555 12094 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 61. Preceding OpId from leader: term: 1 index: 62. (index mismatch)
I20240502 20:45:47.822275 13467 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 60, Time since last communication: 0.000s
I20240502 20:45:47.828231 11565 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 38. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20240502 20:45:47.833652 13405 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 39, Last known committed idx: 38, Time since last communication: 0.000s
I20240502 20:45:47.835209 12094 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 38. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20240502 20:45:47.846865 13405 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 39, Last known committed idx: 38, Time since last communication: 0.000s
I20240502 20:45:47.848006 13303 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 39, Last known committed idx: 38, Time since last communication: 0.000s
I20240502 20:45:47.852309 13303 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.39: config changed from index -1 to 39, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.855221 12094 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.62: config changed from index 48 to 62, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 62 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.856772 11426 catalog_manager.cc:5484] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index -1 to 39, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:47.862712 12221 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.39: config changed from index -1 to 39, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.876796 11961 consensus_queue.cc:237] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 1.64, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:47.879096 13148 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 20:45:47.879858 12223 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 20:45:47.880618 13467 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20240502 20:45:47.881156 13467 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20240502 20:45:47.882961 11832 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 20:45:47.883476 13467 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20240502 20:45:47.886210 12094 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 20:45:47.886484 13467 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.65: config changed from index 62 to 65, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.886629 13308 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20240502 20:45:47.889678 11832 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index 62 to 65, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.890410 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 7261de9012914524a7c43551687fdc0b with cas_config_opid_index 62: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:47.891968 12094 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index 62 to 65, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.892989 13148 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index 62 to 65, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.894891 11422 catalog_manager.cc:5484] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 62 to 65, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.899269 12223 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index 62 to 65, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.899875 11680 tablet_service.cc:1514] Processing DeleteTablet for tablet 7261de9012914524a7c43551687fdc0b with delete_type TABLET_DATA_TOMBSTONED (TS 8096a2fe270b492baa3178ad9d2976e7 not found in new config with opid_index 65) from {username='slave'} at 127.0.0.1:40458
I20240502 20:45:47.902604 11962 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.39: config changed from index -1 to 39, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.918040 13546 tablet_replica.cc:330] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7: stopping tablet replica
I20240502 20:45:47.918455 13546 raft_consensus.cc:2229] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:47.918850 13546 raft_consensus.cc:2258] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:47.928704 11568 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.39: config changed from index -1 to 39, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.930505 12093 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.39: config changed from index -1 to 39, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:47.962752 13546 ts_tablet_manager.cc:1875] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:47.964869 13307 raft_consensus.cc:1050] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:47.965343 13307 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 1.39, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:47.968160 11569 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20240502 20:45:47.968211 11828 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20240502 20:45:47.968907 12223 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20240502 20:45:47.969724 13443 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20240502 20:45:47.970050 13443 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20240502 20:45:47.970325 13443 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20240502 20:45:47.972774 12093 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20240502 20:45:47.972918 13148 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 1 index: 40. (index mismatch)
I20240502 20:45:47.974161 13308 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20240502 20:45:47.978351 13308 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.40: config changed from index 30 to 40, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.982338 13443 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20240502 20:45:47.983203 11568 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.40: config changed from index 30 to 40, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.984387 11832 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.40: config changed from index 30 to 40, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.985198 12094 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.40: config changed from index 30 to 40, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.987138 12223 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.40: config changed from index 30 to 40, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.987419 13148 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.40: config changed from index 30 to 40, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:47.988049 11419 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index 30 to 40, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:47.989871 12221 raft_consensus.cc:1203] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 20:45:47.996412 13546 ts_tablet_manager.cc:1888] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.64
I20240502 20:45:47.996539 13546 log.cc:1196] T 7261de9012914524a7c43551687fdc0b P 8096a2fe270b492baa3178ad9d2976e7: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/7261de9012914524a7c43551687fdc0b
I20240502 20:45:47.997218 11413 catalog_manager.cc:4830] TS 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991): tablet 7261de9012914524a7c43551687fdc0b (table rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]) successfully deleted
I20240502 20:45:48.017238 11962 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 1.41, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:48.017868 13549 ts_tablet_manager.cc:902] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:48.018931 13549 tablet_copy_client.cc:308] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:33233
I20240502 20:45:48.018946 11569 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 42. (index mismatch)
I20240502 20:45:48.019609 11828 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 42. (index mismatch)
I20240502 20:45:48.019589 13308 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 40, Time since last communication: 0.000s
I20240502 20:45:48.020068 13308 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 20:45:48.020758 13148 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 42. (index mismatch)
I20240502 20:45:48.021298 13308 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 20:45:48.022862 13548 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.42: config changed from index 40 to 42, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.027205 12222 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 42. (index mismatch)
I20240502 20:45:48.029294 11419 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index 40 to 42, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:45:48.029506 12917 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 40, Time since last communication: 0.000s
I20240502 20:45:48.029747 11828 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.42: config changed from index 40 to 42, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.031147 13148 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.42: config changed from index 40 to 42, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.031280 12222 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.42: config changed from index 40 to 42, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.033011 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8a2169943b994152ba495bdb810754a0 with cas_config_opid_index 40: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:48.037650 11568 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.42: config changed from index 40 to 42, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.134179 12073 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a2169943b994152ba495bdb810754a0 with delete_type TABLET_DATA_TOMBSTONED (TS 7dd8e38181f24e349fb179d2a9eb74c1 not found in new config with opid_index 42) from {username='slave'} at 127.0.0.1:51414
I20240502 20:45:48.140014 13563 tablet_replica.cc:330] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: stopping tablet replica
I20240502 20:45:48.140431 13563 raft_consensus.cc:2229] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:48.140707 13563 pending_rounds.cc:62] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: Trying to abort 1 pending ops.
I20240502 20:45:48.140774 13563 pending_rounds.cc:68] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: Aborting op as it isn't in flight: id { term: 1 index: 41 } timestamp: 7023340535839870976 op_type: WRITE_OP write_request { tablet_id: "8a2169943b994152ba495bdb810754a0" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000ox\271@p\t1\231\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""dd1ec6999f012d24" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023340535813160960 authz_token { token_data: "\010\244\371\317\261\006\"3\n\005slave\022*\n 325ff00671e5405b9f50dbdea2bf7988\020\001\030\001 \001(\001" signature: "<redacted>""ZO\177q\210\243\230\363\254\034\204\233\017\261(\253\231l@\030j\332<\260\330\352\243\016K\310:\236\250\265\333\013\307)Si\304\022z\307/\316\332\203\346\305\n\224C\232`\303\021Y\211y\372\0352\231" signing_key_seq_num: 0 } } request_id { client_id: "1303084e630f4ca08751491b832aa237" seq_no: 111 first_incomplete_seq_no: 111 attempt_no: 0 }
I20240502 20:45:48.141141 13563 raft_consensus.cc:2258] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:48.142546 13563 ts_tablet_manager.cc:1875] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:48.147257 12114 tablet_copy_service.cc:140] P 7dd8e38181f24e349fb179d2a9eb74c1: Received BeginTabletCopySession request for tablet ed4d27cc41454a108252941a99cd16e2 from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:49297)
I20240502 20:45:48.147394 12114 tablet_copy_service.cc:161] P 7dd8e38181f24e349fb179d2a9eb74c1: Beginning new tablet copy session on tablet ed4d27cc41454a108252941a99cd16e2 from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:49297: session id = 8824a7df8ec9431db37c0bb434ede060-ed4d27cc41454a108252941a99cd16e2
I20240502 20:45:48.148320 12114 tablet_copy_source_session.cc:205] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:48.149705 13549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4d27cc41454a108252941a99cd16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:48.152652 13549 tablet_copy_client.cc:783] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:48.153050 13549 tablet_copy_client.cc:647] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:48.154316 13549 tablet_copy_client.cc:523] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:48.155835 13549 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:48.178187 13563 ts_tablet_manager.cc:1888] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.41
I20240502 20:45:48.183027 13563 log.cc:1196] T 8a2169943b994152ba495bdb810754a0 P 7dd8e38181f24e349fb179d2a9eb74c1: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/8a2169943b994152ba495bdb810754a0
I20240502 20:45:48.211828 13560 ts_tablet_manager.cc:902] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991)
I20240502 20:45:48.217852 11413 catalog_manager.cc:4830] TS 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233): tablet 8a2169943b994152ba495bdb810754a0 (table rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]) successfully deleted
I20240502 20:45:48.218590 13560 tablet_copy_client.cc:308] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:43991
I20240502 20:45:48.257967 11721 tablet_copy_service.cc:140] P 8096a2fe270b492baa3178ad9d2976e7: Received BeginTabletCopySession request for tablet 1d55d69fcfb44cb29751908f32fb393f from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:53123)
I20240502 20:45:48.258152 11721 tablet_copy_service.cc:161] P 8096a2fe270b492baa3178ad9d2976e7: Beginning new tablet copy session on tablet 1d55d69fcfb44cb29751908f32fb393f from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:53123: session id = 8824a7df8ec9431db37c0bb434ede060-1d55d69fcfb44cb29751908f32fb393f
I20240502 20:45:48.259907 11721 tablet_copy_source_session.cc:205] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:48.278884 13560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d55d69fcfb44cb29751908f32fb393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:48.300555 13564 ts_tablet_manager.cc:902] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:48.302022 13564 tablet_copy_client.cc:308] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:42315
I20240502 20:45:48.310626 11852 tablet_copy_service.cc:140] P 07fe14e7347a4682bd8f6026ad776da3: Received BeginTabletCopySession request for tablet 2bbffeb3e45e4ab78112632675d55ac6 from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:34397)
I20240502 20:45:48.310817 11852 tablet_copy_service.cc:161] P 07fe14e7347a4682bd8f6026ad776da3: Beginning new tablet copy session on tablet 2bbffeb3e45e4ab78112632675d55ac6 from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:34397: session id = 8824a7df8ec9431db37c0bb434ede060-2bbffeb3e45e4ab78112632675d55ac6
I20240502 20:45:48.312438 11852 tablet_copy_source_session.cc:205] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:48.315232 13564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbffeb3e45e4ab78112632675d55ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:48.354890 13564 tablet_copy_client.cc:783] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:48.355185 13564 tablet_copy_client.cc:647] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:48.369935 13564 tablet_copy_client.cc:523] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:48.371239 13560 tablet_copy_client.cc:783] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:48.371457 13560 tablet_copy_client.cc:647] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:48.371536 13564 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:48.383273 13560 tablet_copy_client.cc:523] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:48.399200 13560 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:48.560453 13549 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=40 overwritten=0 applied=40 ignored=0} inserts{seen=712 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:48.562814 13549 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:48.563306 13549 ts_tablet_manager.cc:1367] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.408s user 0.056s sys 0.000s
I20240502 20:45:48.563771 13549 raft_consensus.cc:348] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:48.563912 13549 raft_consensus.cc:729] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:48.564000 13549 consensus_queue.cc:260] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 40, Last appended: 1.40, Last appended by leader: 40, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:48.564319 13549 ts_tablet_manager.cc:1398] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:48.565411 12114 tablet_copy_service.cc:342] P 7dd8e38181f24e349fb179d2a9eb74c1: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-ed4d27cc41454a108252941a99cd16e2 received from {username='slave'} at 127.9.82.135:49297
I20240502 20:45:48.565513 12114 tablet_copy_service.cc:433] P 7dd8e38181f24e349fb179d2a9eb74c1: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-ed4d27cc41454a108252941a99cd16e2 on tablet ed4d27cc41454a108252941a99cd16e2 with peer 8824a7df8ec9431db37c0bb434ede060
I20240502 20:45:48.571982 13421 raft_consensus.cc:1050] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: attempting to promote NON_VOTER 72cfad7451c64ef59a18e09d16a79046 to VOTER
I20240502 20:45:48.572583 13421 consensus_queue.cc:237] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } }
I20240502 20:45:48.574471 13148 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 20:45:48.574952 13420 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 20:45:48.576248 11829 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 20:45:48.577041 11962 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 20:45:48.578193 13049 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 20:45:48.579578 12797 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 20:45:48.595817 13564 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=43 overwritten=0 applied=43 ignored=0} inserts{seen=674 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:48.596194 13564 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:48.596396 13564 ts_tablet_manager.cc:1367] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.225s user 0.052s sys 0.004s
I20240502 20:45:48.596871 13564 raft_consensus.cc:348] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:48.597007 13564 raft_consensus.cc:729] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:48.597095 13564 consensus_queue.cc:260] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 43, Last appended: 1.43, Last appended by leader: 43, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 39 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:48.597347 13564 ts_tablet_manager.cc:1398] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:48.598219 11852 tablet_copy_service.cc:342] P 07fe14e7347a4682bd8f6026ad776da3: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-2bbffeb3e45e4ab78112632675d55ac6 received from {username='slave'} at 127.9.82.135:34397
I20240502 20:45:48.598321 11852 tablet_copy_service.cc:433] P 07fe14e7347a4682bd8f6026ad776da3: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-2bbffeb3e45e4ab78112632675d55ac6 on tablet 2bbffeb3e45e4ab78112632675d55ac6 with peer 8824a7df8ec9431db37c0bb434ede060
I20240502 20:45:48.599164 13148 raft_consensus.cc:1203] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.32->[1.33-1.45] Dedup: 1.40->[1.41-1.45]
I20240502 20:45:48.606079 11698 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 20:45:48.613422 13420 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 20:45:48.644069 12223 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEARNER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 20:45:48.644941 13420 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 20:45:48.665516 12797 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.667976 11829 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.668015 11699 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.668668 13163 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.671669 11417 catalog_manager.cc:5484] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 2 to 3, 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:48.723347 11961 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.752683 13420 raft_consensus.cc:1050] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:48.753206 13420 consensus_queue.cc:237] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 1.46, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:48.759609 13148 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 20:45:48.760263 13589 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:48.764390 11699 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 20:45:48.765318 11569 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 20:45:48.766997 12222 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 20:45:48.767109 13589 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:48.768800 13589 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:48.771237 11960 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 20:45:48.776338 13589 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:48.781006 13589 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:48.782331 12094 consensus_queue.cc:237] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } }
I20240502 20:45:48.788525 13589 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.47: config changed from index 33 to 47, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.790606 12223 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.790829 13148 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 33 to 47, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.792863 11426 catalog_manager.cc:5484] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 33 to 47, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:45:48.795796 13148 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:45:48.795920 11565 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 33 to 47, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.798069 13590 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:45:48.798180 11700 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 33 to 47, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.801822 12224 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:45:48.803086 13590 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:45:48.804828 11829 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:45:48.805522 12223 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 33 to 47, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
W20240502 20:45:48.806797 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 48018us
I20240502 20:45:48.808141 11961 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:45:48.809170 13271 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:45:48.809518 12093 consensus_queue.cc:237] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 1.47, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:48.810987 13421 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:45:48.811633 11700 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:48.811758 13148 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:48.812171 13273 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20240502 20:45:48.812515 13273 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20240502 20:45:48.812527 11961 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:48.813616 12225 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:48.814421 13271 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:48.814631 13273 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20240502 20:45:48.814910 12797 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.815044 11829 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.816402 11963 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 33 to 47, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.816794 12797 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.48: config changed from index 47 to 48, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.817979 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 959ee5415c0a44bbaf7bb3a1ba870902 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:48.818290 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ed4d27cc41454a108252941a99cd16e2 with cas_config_opid_index 47: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:48.819556 11425 catalog_manager.cc:5484] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 3 to 4, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.819697 13163 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.820396 11699 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index 47 to 48, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.819974 13148 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index 47 to 48, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.823238 11426 catalog_manager.cc:5484] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index 47 to 48, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.823644 12223 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.830209 11680 tablet_service.cc:1514] Processing DeleteTablet for tablet 959ee5415c0a44bbaf7bb3a1ba870902 with delete_type TABLET_DATA_TOMBSTONED (TS 8096a2fe270b492baa3178ad9d2976e7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40458
I20240502 20:45:48.831328 11960 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } }
I20240502 20:45:48.832149 11549 tablet_service.cc:1514] Processing DeleteTablet for tablet ed4d27cc41454a108252941a99cd16e2 with delete_type TABLET_DATA_TOMBSTONED (TS 5521e131639043f8b116f9c71cf4bfee not found in new config with opid_index 48) from {username='slave'} at 127.0.0.1:60196
I20240502 20:45:48.833833 11960 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index 47 to 48, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.841087 12223 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index 47 to 48, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:48.843911 13623 tablet_replica.cc:330] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: stopping tablet replica
I20240502 20:45:48.844151 13623 raft_consensus.cc:2229] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:48.844502 13624 tablet_replica.cc:330] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee: stopping tablet replica
I20240502 20:45:48.844766 13623 raft_consensus.cc:2258] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:48.845194 13624 raft_consensus.cc:2229] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:48.845571 13624 raft_consensus.cc:2258] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:48.851054 13623 ts_tablet_manager.cc:1875] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:48.854071 13624 ts_tablet_manager.cc:1875] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:48.858044 13623 ts_tablet_manager.cc:1888] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 20:45:48.858151 13623 log.cc:1196] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8096a2fe270b492baa3178ad9d2976e7: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/959ee5415c0a44bbaf7bb3a1ba870902
I20240502 20:45:48.858868 11413 catalog_manager.cc:4830] TS 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991): tablet 959ee5415c0a44bbaf7bb3a1ba870902 (table TestTable [id=24950fede60f4eeba3f6c0e0914d81ef]) successfully deleted
I20240502 20:45:48.859977 13624 ts_tablet_manager.cc:1888] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.47
I20240502 20:45:48.860095 13624 log.cc:1196] T ed4d27cc41454a108252941a99cd16e2 P 5521e131639043f8b116f9c71cf4bfee: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/ed4d27cc41454a108252941a99cd16e2
I20240502 20:45:48.860750 11413 catalog_manager.cc:4830] TS 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161): tablet ed4d27cc41454a108252941a99cd16e2 (table rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]) successfully deleted
I20240502 20:45:48.936937 13560 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=68 overwritten=0 applied=68 ignored=0} inserts{seen=699 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:48.937343 13560 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:48.984598 13560 ts_tablet_manager.cc:1367] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.585s user 0.078s sys 0.005s
I20240502 20:45:48.985327 13560 raft_consensus.cc:348] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:48.986027 13560 raft_consensus.cc:729] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:48.987169 13560 consensus_queue.cc:260] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 68, Last appended: 1.68, Last appended by leader: 68, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:48.988427 13560 ts_tablet_manager.cc:1398] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:45:48.989109 11721 tablet_copy_service.cc:342] P 8096a2fe270b492baa3178ad9d2976e7: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-1d55d69fcfb44cb29751908f32fb393f received from {username='slave'} at 127.9.82.135:53123
I20240502 20:45:48.989241 11721 tablet_copy_service.cc:433] P 8096a2fe270b492baa3178ad9d2976e7: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-1d55d69fcfb44cb29751908f32fb393f on tablet 1d55d69fcfb44cb29751908f32fb393f with peer 8824a7df8ec9431db37c0bb434ede060
I20240502 20:45:49.060525 13148 raft_consensus.cc:1203] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.38->[1.39-1.51] Dedup: 1.43->[1.44-1.51]
I20240502 20:45:49.067494 12094 consensus_queue.cc:237] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 1.47, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
W20240502 20:45:49.070478 12029 consensus_peers.cc:485] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 319f281517f54ed6998fd74a849b07eb. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:49.075089 12223 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:49.076764 13589 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:49.108197 11565 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:49.108916 11699 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:49.111536 11963 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 47. Preceding OpId from leader: term: 1 index: 48. (index mismatch)
I20240502 20:45:49.130461 13590 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:49.138549 13590 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:49.140319 13148 raft_consensus.cc:1203] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.46->[1.47-1.88] Dedup: 1.68->[1.69-1.88]
I20240502 20:45:49.166334 13590 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 46, Time since last communication: 0.000s
I20240502 20:45:49.188464 13273 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.189433 11700 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.193313 11421 catalog_manager.cc:5484] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.197059 12224 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.218705 13446 raft_consensus.cc:1050] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:49.219326 13446 consensus_queue.cc:237] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 1.89, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 90 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:49.221179 13163 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 89. Preceding OpId from leader: term: 1 index: 90. (index mismatch)
I20240502 20:45:49.221586 13537 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20240502 20:45:49.222414 12094 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 89. Preceding OpId from leader: term: 1 index: 90. (index mismatch)
W20240502 20:45:49.223737 11898 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.135:44285, user_credentials={real_user=slave}} blocked reactor thread for 55109.2us
I20240502 20:45:49.224076 13537 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20240502 20:45:49.228590 11828 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 89. Preceding OpId from leader: term: 1 index: 90. (index mismatch)
I20240502 20:45:49.228994 13301 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20240502 20:45:49.229913 11565 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.242107 13537 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.90: config changed from index 47 to 90, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 90 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.245034 12093 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.90: config changed from index 47 to 90, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 90 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.245105 13163 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.90: config changed from index 47 to 90, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 90 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.248310 11422 catalog_manager.cc:5484] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 reported cstate change: config changed from index 47 to 90, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 90 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.255800 11829 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.90: config changed from index 47 to 90, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 90 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.269924 12223 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 89. Preceding OpId from leader: term: 1 index: 90. (index mismatch)
I20240502 20:45:49.270759 13301 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20240502 20:45:49.271632 12225 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.90: config changed from index 47 to 90, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 90 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.303071 11960 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 89. Preceding OpId from leader: term: 1 index: 90. (index mismatch)
I20240502 20:45:49.309672 13447 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 88, Time since last communication: 0.000s
I20240502 20:45:49.315166 11961 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.48: config changed from index -1 to 48, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.329595 11960 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.90: config changed from index 47 to 90, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 90 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.349613 11828 consensus_queue.cc:237] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 1.56, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
W20240502 20:45:49.351649 11767 consensus_peers.cc:485] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81c3873a4eab471da0c19e8bf0eaf03d. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:49.358405 12225 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 56. Preceding OpId from leader: term: 1 index: 57. (index mismatch)
I20240502 20:45:49.359297 13547 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20240502 20:45:49.365320 11570 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 56. Preceding OpId from leader: term: 1 index: 57. (index mismatch)
I20240502 20:45:49.366297 11700 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 56. Preceding OpId from leader: term: 1 index: 57. (index mismatch)
I20240502 20:45:49.367714 11963 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 56. Preceding OpId from leader: term: 1 index: 57. (index mismatch)
I20240502 20:45:49.370400 13304 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20240502 20:45:49.376670 13304 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20240502 20:45:49.377234 13304 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20240502 20:45:49.401734 13591 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.57: config changed from index -1 to 57, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.405117 12223 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.57: config changed from index -1 to 57, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.407500 11421 catalog_manager.cc:5484] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index -1 to 57, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:49.423435 11698 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.57: config changed from index -1 to 57, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.433696 11569 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.57: config changed from index -1 to 57, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:49.441642 11963 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.57: config changed from index -1 to 57, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
W20240502 20:45:49.457273 12030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 46655.5us
I20240502 20:45:49.461124 13304 raft_consensus.cc:1050] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:49.461655 13304 consensus_queue.cc:237] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 1.52, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 53 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:49.464008 12223 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 52. Preceding OpId from leader: term: 1 index: 53. (index mismatch)
I20240502 20:45:49.464210 13148 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 52. Preceding OpId from leader: term: 1 index: 53. (index mismatch)
I20240502 20:45:49.464381 13547 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 51, Time since last communication: 0.000s
I20240502 20:45:49.464598 13228 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 51, Time since last communication: 0.000s
I20240502 20:45:49.473795 11962 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 52. Preceding OpId from leader: term: 1 index: 53. (index mismatch)
I20240502 20:45:49.479316 11569 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 52. Preceding OpId from leader: term: 1 index: 53. (index mismatch)
I20240502 20:45:49.484050 13228 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 51, Time since last communication: 0.000s
I20240502 20:45:49.489840 13228 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 51, Time since last communication: 0.000s
I20240502 20:45:49.494799 13591 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.53: config changed from index 39 to 53, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 53 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.498283 12223 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.53: config changed from index 39 to 53, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 53 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.498525 11421 catalog_manager.cc:5484] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 39 to 53, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 53 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:45:49.501442 13148 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.53: config changed from index 39 to 53, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 53 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.510111 11958 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.53: config changed from index 39 to 53, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 53 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.515543 12094 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 52. Preceding OpId from leader: term: 1 index: 53. (index mismatch)
I20240502 20:45:49.544211 11566 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.53: config changed from index 39 to 53, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 53 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.544999 13228 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 51, Time since last communication: 0.000s
I20240502 20:45:49.594820 12093 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.53: config changed from index 39 to 53, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 53 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.643493 13670 ts_tablet_manager.cc:902] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:45:49.645644 13670 tablet_copy_client.cc:308] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:33233
I20240502 20:45:49.647266 12114 tablet_copy_service.cc:140] P 7dd8e38181f24e349fb179d2a9eb74c1: Received BeginTabletCopySession request for tablet 319f281517f54ed6998fd74a849b07eb from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:49297)
I20240502 20:45:49.647383 12114 tablet_copy_service.cc:161] P 7dd8e38181f24e349fb179d2a9eb74c1: Beginning new tablet copy session on tablet 319f281517f54ed6998fd74a849b07eb from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:49297: session id = 8824a7df8ec9431db37c0bb434ede060-319f281517f54ed6998fd74a849b07eb
I20240502 20:45:49.648419 12114 tablet_copy_source_session.cc:205] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:49.656625 13670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319f281517f54ed6998fd74a849b07eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:49.665138 13670 tablet_copy_client.cc:783] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:49.665511 13670 tablet_copy_client.cc:647] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:49.669997 13670 tablet_copy_client.cc:523] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:49.685348 13670 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:49.693285 11700 consensus_queue.cc:237] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 1.91, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 92 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:49.697508 12093 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 91. Preceding OpId from leader: term: 1 index: 92. (index mismatch)
I20240502 20:45:49.697976 13638 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 90, Time since last communication: 0.000s
I20240502 20:45:49.698838 11963 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 91. Preceding OpId from leader: term: 1 index: 92. (index mismatch)
I20240502 20:45:49.700354 12223 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 91. Preceding OpId from leader: term: 1 index: 92. (index mismatch)
I20240502 20:45:49.700762 13638 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 90, Time since last communication: 0.000s
I20240502 20:45:49.702140 13161 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 91. Preceding OpId from leader: term: 1 index: 92. (index mismatch)
I20240502 20:45:49.703233 13638 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.92: config changed from index 90 to 92, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 92 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.712234 13446 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 90, Time since last communication: 0.000s
I20240502 20:45:49.712138 12224 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.92: config changed from index 90 to 92, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 92 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.714705 13446 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 90, Time since last communication: 0.000s
I20240502 20:45:49.714910 11421 catalog_manager.cc:5484] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index 90 to 92, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 92 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:49.715767 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1d55d69fcfb44cb29751908f32fb393f with cas_config_opid_index 90: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:49.715931 11959 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.92: config changed from index 90 to 92, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 92 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.718677 11810 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d55d69fcfb44cb29751908f32fb393f with delete_type TABLET_DATA_TOMBSTONED (TS 07fe14e7347a4682bd8f6026ad776da3 not found in new config with opid_index 92) from {username='slave'} at 127.0.0.1:39248
I20240502 20:45:49.719224 13681 tablet_replica.cc:330] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: stopping tablet replica
I20240502 20:45:49.719815 13681 raft_consensus.cc:2229] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:49.720057 13681 pending_rounds.cc:62] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: Trying to abort 1 pending ops.
I20240502 20:45:49.720189 13681 pending_rounds.cc:68] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: Aborting op as it isn't in flight: id { term: 1 index: 91 } timestamp: 7023340542719303680 op_type: WRITE_OP write_request { tablet_id: "1d55d69fcfb44cb29751908f32fb393f" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\214\r{`\245T\242T\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""c8878124705ecdb7" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023340542423289856 authz_token { token_data: "\010\244\371\317\261\006\"3\n\005slave\022*\n 3bb7f1c7d1784156bcc791c4fa43edb7\020\001\030\001 \001(\001" signature: "<redacted>""\265\026r\025\035\236!\345v\004q\356?b\321\340\3700\270#\273:\345\304xq\325\213\303\2335\201\006\236D\347\207s\227\373\3071zm\331|\001\336\360\253T\006C\2378Ef\377\310D\220\2074\234" signing_key_seq_num: 0 } } request_id { client_id: "66f22e74a75c4fd4b34ff63edbb27a89" seq_no: 245 first_incomplete_seq_no: 245 attempt_no: 0 }
I20240502 20:45:49.720992 13681 raft_consensus.cc:2258] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:49.720875 12094 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.92: config changed from index 90 to 92, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 92 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.722434 13681 ts_tablet_manager.cc:1875] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:49.727648 13681 ts_tablet_manager.cc:1888] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.91
I20240502 20:45:49.727859 13681 log.cc:1196] T 1d55d69fcfb44cb29751908f32fb393f P 07fe14e7347a4682bd8f6026ad776da3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/1d55d69fcfb44cb29751908f32fb393f
I20240502 20:45:49.730602 13162 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.92: config changed from index 90 to 92, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 92 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.758536 11411 catalog_manager.cc:4830] TS 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315): tablet 1d55d69fcfb44cb29751908f32fb393f (table rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]) successfully deleted
I20240502 20:45:49.813023 11828 consensus_queue.cc:237] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 1.54, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 55 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:49.815398 13162 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 54. Preceding OpId from leader: term: 1 index: 55. (index mismatch)
I20240502 20:45:49.815840 13304 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 53, Time since last communication: 0.000s
I20240502 20:45:49.820742 12223 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 54. Preceding OpId from leader: term: 1 index: 55. (index mismatch)
I20240502 20:45:49.823462 13408 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 53, Time since last communication: 0.000s
I20240502 20:45:49.826014 13304 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.55: config changed from index 53 to 55, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 55 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.828182 11411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2bbffeb3e45e4ab78112632675d55ac6 with cas_config_opid_index 53: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:49.829977 13162 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.55: config changed from index 53 to 55, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 55 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.833925 11422 catalog_manager.cc:5484] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 reported cstate change: config changed from index 53 to 55, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 55 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.839972 12223 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.55: config changed from index 53 to 55, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 55 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.841410 11941 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bbffeb3e45e4ab78112632675d55ac6 with delete_type TABLET_DATA_TOMBSTONED (TS 6529b03451c9475ab62c51f71714b0cf not found in new config with opid_index 55) from {username='slave'} at 127.0.0.1:39680
I20240502 20:45:49.856472 13686 ts_tablet_manager.cc:902] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:49.857117 13686 tablet_copy_client.cc:308] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:42315
I20240502 20:45:49.858850 11852 tablet_copy_service.cc:140] P 07fe14e7347a4682bd8f6026ad776da3: Received BeginTabletCopySession request for tablet 81c3873a4eab471da0c19e8bf0eaf03d from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:34397)
I20240502 20:45:49.858959 11852 tablet_copy_service.cc:161] P 07fe14e7347a4682bd8f6026ad776da3: Beginning new tablet copy session on tablet 81c3873a4eab471da0c19e8bf0eaf03d from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:34397: session id = 8824a7df8ec9431db37c0bb434ede060-81c3873a4eab471da0c19e8bf0eaf03d
I20240502 20:45:49.859978 11852 tablet_copy_source_session.cc:205] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:49.867009 13686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81c3873a4eab471da0c19e8bf0eaf03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:49.875945 13685 tablet_replica.cc:330] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf: stopping tablet replica
I20240502 20:45:49.876717 13685 raft_consensus.cc:2229] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:49.877460 13685 raft_consensus.cc:2258] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:49.882184 13685 ts_tablet_manager.cc:1875] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:49.882300 13686 tablet_copy_client.cc:783] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:49.882501 13686 tablet_copy_client.cc:647] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:49.887822 13685 ts_tablet_manager.cc:1888] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.53
I20240502 20:45:49.889649 13685 log.cc:1196] T 2bbffeb3e45e4ab78112632675d55ac6 P 6529b03451c9475ab62c51f71714b0cf: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/2bbffeb3e45e4ab78112632675d55ac6
I20240502 20:45:49.890483 13686 tablet_copy_client.cc:523] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:49.890583 11413 catalog_manager.cc:4830] TS 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493): tablet 2bbffeb3e45e4ab78112632675d55ac6 (table rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]) successfully deleted
I20240502 20:45:49.896162 13686 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:49.935521 13670 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=53 overwritten=0 applied=53 ignored=0} inserts{seen=725 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:49.936026 13670 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:49.936311 13670 ts_tablet_manager.cc:1367] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.251s user 0.065s sys 0.000s
I20240502 20:45:49.936858 13670 raft_consensus.cc:348] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:49.937150 13670 raft_consensus.cc:729] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:49.937294 13670 consensus_queue.cc:260] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 53, Last appended: 1.53, Last appended by leader: 53, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 48 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:49.937783 13670 ts_tablet_manager.cc:1398] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:49.939288 12114 tablet_copy_service.cc:342] P 7dd8e38181f24e349fb179d2a9eb74c1: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-319f281517f54ed6998fd74a849b07eb received from {username='slave'} at 127.9.82.135:49297
I20240502 20:45:49.939378 12114 tablet_copy_service.cc:433] P 7dd8e38181f24e349fb179d2a9eb74c1: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-319f281517f54ed6998fd74a849b07eb on tablet 319f281517f54ed6998fd74a849b07eb with peer 8824a7df8ec9431db37c0bb434ede060
I20240502 20:45:49.973798 11568 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 1 index: 55. (index mismatch)
I20240502 20:45:49.979106 12094 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 1 index: 55. (index mismatch)
I20240502 20:45:49.979511 13547 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 53, Time since last communication: 0.000s
I20240502 20:45:49.983429 11568 raft_consensus.cc:1203] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.53->[1.54-1.59] Dedup: 1.54->[1.55-1.59]
I20240502 20:45:49.984616 11568 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.55: config changed from index 53 to 55, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 55 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:49.985539 13547 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 53, Time since last communication: 0.000s
I20240502 20:45:49.992666 13162 raft_consensus.cc:1203] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.47->[1.48-1.54] Dedup: 1.53->[1.54-1.54]
I20240502 20:45:49.994271 12094 raft_consensus.cc:1203] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.53->[1.54-1.59] Dedup: 1.54->[1.55-1.59]
I20240502 20:45:49.995251 12094 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.55: config changed from index 53 to 55, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 55 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.110668 13686 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=61 overwritten=0 applied=61 ignored=0} inserts{seen=746 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:50.111078 13686 tablet_bootstrap.cc:492] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:50.111340 13686 ts_tablet_manager.cc:1367] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.215s user 0.064s sys 0.008s
I20240502 20:45:50.111891 13686 raft_consensus.cc:348] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:50.112036 13686 raft_consensus.cc:729] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:50.112200 13686 consensus_queue.cc:260] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 61, Last appended: 1.61, Last appended by leader: 61, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:50.113699 13686 ts_tablet_manager.cc:1398] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:45:50.115043 11852 tablet_copy_service.cc:342] P 07fe14e7347a4682bd8f6026ad776da3: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-81c3873a4eab471da0c19e8bf0eaf03d received from {username='slave'} at 127.9.82.135:34397
I20240502 20:45:50.115125 11852 tablet_copy_service.cc:433] P 07fe14e7347a4682bd8f6026ad776da3: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-81c3873a4eab471da0c19e8bf0eaf03d on tablet 81c3873a4eab471da0c19e8bf0eaf03d with peer 8824a7df8ec9431db37c0bb434ede060
I20240502 20:45:50.165376 13421 raft_consensus.cc:1050] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:50.165850 13421 consensus_queue.cc:237] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 1.55, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:50.168553 12222 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 55. Preceding OpId from leader: term: 1 index: 56. (index mismatch)
I20240502 20:45:50.168571 11569 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 55. Preceding OpId from leader: term: 1 index: 56. (index mismatch)
I20240502 20:45:50.168674 13146 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 55. Preceding OpId from leader: term: 1 index: 56. (index mismatch)
I20240502 20:45:50.169096 11698 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 55. Preceding OpId from leader: term: 1 index: 56. (index mismatch)
I20240502 20:45:50.169229 12797 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20240502 20:45:50.169641 11960 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 55. Preceding OpId from leader: term: 1 index: 56. (index mismatch)
I20240502 20:45:50.169911 12797 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20240502 20:45:50.170209 13271 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 54, Time since last communication: 0.000s
I20240502 20:45:50.173023 13590 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20240502 20:45:50.179553 13420 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20240502 20:45:50.194610 12797 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.56: config changed from index 48 to 56, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.197115 12224 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.56: config changed from index 48 to 56, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.198104 11422 catalog_manager.cc:5484] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 48 to 56, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:50.198457 11566 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.56: config changed from index 48 to 56, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.199518 11699 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.56: config changed from index 48 to 56, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.202306 13146 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.56: config changed from index 48 to 56, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.203541 12093 consensus_queue.cc:237] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 1.57, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 58 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:50.208245 13146 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 57. Preceding OpId from leader: term: 1 index: 58. (index mismatch)
I20240502 20:45:50.208840 13421 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20240502 20:45:50.209852 11566 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 57. Preceding OpId from leader: term: 1 index: 58. (index mismatch)
I20240502 20:45:50.210783 11959 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 57. Preceding OpId from leader: term: 1 index: 58. (index mismatch)
I20240502 20:45:50.211766 13590 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20240502 20:45:50.211910 13421 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 55, Time since last communication: 0.000s
I20240502 20:45:50.212527 11699 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 57. Preceding OpId from leader: term: 1 index: 58. (index mismatch)
I20240502 20:45:50.212895 13590 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20240502 20:45:50.217280 13590 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.58: config changed from index 56 to 58, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 58 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.217738 11961 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.56: config changed from index 48 to 56, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.220883 13162 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.58: config changed from index 56 to 58, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 58 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.221248 11422 catalog_manager.cc:5484] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 56 to 58, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 58 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:45:50.227602 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 319f281517f54ed6998fd74a849b07eb with cas_config_opid_index 56: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:50.234699 11700 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.58: config changed from index 56 to 58, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 58 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.245842 11568 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.58: config changed from index 56 to 58, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 58 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.284809 13162 raft_consensus.cc:1203] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.56->[1.57-1.63] Dedup: 1.61->[1.62-1.63]
I20240502 20:45:50.301169 12205 tablet_service.cc:1514] Processing DeleteTablet for tablet 319f281517f54ed6998fd74a849b07eb with delete_type TABLET_DATA_TOMBSTONED (TS 72cfad7451c64ef59a18e09d16a79046 not found in new config with opid_index 58) from {username='slave'} at 127.0.0.1:36220
I20240502 20:45:50.320978 11960 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.58: config changed from index 56 to 58, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 58 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.337261 13547 raft_consensus.cc:1050] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:50.337716 13547 consensus_queue.cc:237] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 1.64, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:50.339334 13146 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 20:45:50.340189 13405 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 63, Time since last communication: 0.000s
I20240502 20:45:50.341118 13709 tablet_replica.cc:330] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046: stopping tablet replica
I20240502 20:45:50.342468 12223 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 20:45:50.347430 13408 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 63, Time since last communication: 0.000s
I20240502 20:45:50.350742 13709 raft_consensus.cc:2229] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:50.352393 11699 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 20:45:50.352963 11960 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 63. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 20:45:50.353602 11565 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 63. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 20:45:50.355494 13408 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 63, Time since last communication: 0.000s
I20240502 20:45:50.357376 13709 raft_consensus.cc:2258] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:50.358928 13408 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 63, Time since last communication: 0.000s
I20240502 20:45:50.360507 13408 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 63, Time since last communication: 0.000s
I20240502 20:45:50.369617 13304 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.65: config changed from index 57 to 65, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.375146 13148 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index 57 to 65, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.375841 12224 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index 57 to 65, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.379281 11419 catalog_manager.cc:5484] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060 reported cstate change: config changed from index 57 to 65, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.370122 11961 raft_consensus.cc:1203] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.63->[1.64-1.65] Dedup: 1.64->[1.65-1.65]
I20240502 20:45:50.378960 13709 ts_tablet_manager.cc:1875] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:50.391369 13709 ts_tablet_manager.cc:1888] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.57
I20240502 20:45:50.391604 13709 log.cc:1196] T 319f281517f54ed6998fd74a849b07eb P 72cfad7451c64ef59a18e09d16a79046: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/wals/319f281517f54ed6998fd74a849b07eb
I20240502 20:45:50.392598 11411 catalog_manager.cc:4830] TS 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241): tablet 319f281517f54ed6998fd74a849b07eb (table rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]) successfully deleted
I20240502 20:45:50.420924 11699 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index 57 to 65, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.433497 11829 consensus_queue.cc:237] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 1.66, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 67 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:50.436532 12223 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 66. Preceding OpId from leader: term: 1 index: 67. (index mismatch)
I20240502 20:45:50.436923 13228 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 65, Time since last communication: 0.000s
I20240502 20:45:50.439157 13148 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 66. Preceding OpId from leader: term: 1 index: 67. (index mismatch)
I20240502 20:45:50.439673 13408 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 65, Time since last communication: 0.000s
I20240502 20:45:50.443260 13408 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.67: config changed from index 65 to 67, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 67 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.445556 12223 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.67: config changed from index 65 to 67, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 67 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.449127 11411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 81c3873a4eab471da0c19e8bf0eaf03d with cas_config_opid_index 65: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:50.449185 11422 catalog_manager.cc:5484] T 81c3873a4eab471da0c19e8bf0eaf03d P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: config changed from index 65 to 67, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 67 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.452678 13148 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.67: config changed from index 65 to 67, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 67 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
W20240502 20:45:50.487651 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.129:36161, user_credentials={real_user=slave}} blocked reactor thread for 53680.6us
I20240502 20:45:50.487932 11549 tablet_service.cc:1514] Processing DeleteTablet for tablet 81c3873a4eab471da0c19e8bf0eaf03d with delete_type TABLET_DATA_TOMBSTONED (TS 5521e131639043f8b116f9c71cf4bfee not found in new config with opid_index 67) from {username='slave'} at 127.0.0.1:60196
I20240502 20:45:50.514895 13713 tablet_replica.cc:330] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: stopping tablet replica
I20240502 20:45:50.516002 13713 raft_consensus.cc:2229] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:50.516194 13713 pending_rounds.cc:62] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: Trying to abort 2 pending ops.
I20240502 20:45:50.516278 13713 pending_rounds.cc:68] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: Aborting op as it isn't in flight: id { term: 1 index: 65 } timestamp: 7023340545382215680 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" old_config { opid_index: 57 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } } new_config { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } } }
I20240502 20:45:50.516511 13713 raft_consensus.cc:2894] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Aborting config change with OpId 1.65: Aborted: Op aborted
I20240502 20:45:50.516635 13713 raft_consensus.cc:2866] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240502 20:45:50.516748 13713 pending_rounds.cc:68] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: Aborting op as it isn't in flight: id { term: 1 index: 64 } timestamp: 7023340545369350144 op_type: WRITE_OP write_request { tablet_id: "81c3873a4eab471da0c19e8bf0eaf03d" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\274\3379B4K\n\305\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""7d23b52d6697796d" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023340545172885504 authz_token { token_data: "\010\244\371\317\261\006\"3\n\005slave\022*\n 8692bbc8498d4349be9f1249324c8322\020\001\030\001 \001(\001" signature: "<redacted>""\236\177k5\024g\370\356m\325\030\235\321\3716\366\310\016\246\207\023;\371+\227\242G\206L\246\344s\245\240\213\206B\360\344\207\366\232\3624\303\206\324\375os\nk\347\372\334b6\374\320\277\353p\001\003" signing_key_seq_num: 0 } } request_id { client_id: "ee278263b94f495f89b8a40d6355671a" seq_no: 152 first_incomplete_seq_no: 152 attempt_no: 0 }
I20240502 20:45:50.517086 13713 raft_consensus.cc:2258] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:50.517742 13713 ts_tablet_manager.cc:1875] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:50.520159 13713 ts_tablet_manager.cc:1888] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.65
I20240502 20:45:50.520304 13713 log.cc:1196] T 81c3873a4eab471da0c19e8bf0eaf03d P 5521e131639043f8b116f9c71cf4bfee: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/81c3873a4eab471da0c19e8bf0eaf03d
I20240502 20:45:50.520963 11413 catalog_manager.cc:4830] TS 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161): tablet 81c3873a4eab471da0c19e8bf0eaf03d (table rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]) successfully deleted
I20240502 20:45:50.544461 11698 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 65. Preceding OpId from leader: term: 1 index: 67. (index mismatch)
I20240502 20:45:50.545886 11960 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index 57 to 65, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.546811 13591 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 65, Time since last communication: 0.000s
I20240502 20:45:50.549414 11700 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.67: config changed from index 65 to 67, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 67 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.570159 11958 raft_consensus.cc:1261] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 66. Preceding OpId from leader: term: 1 index: 67. (index mismatch)
I20240502 20:45:50.578317 13408 consensus_queue.cc:1035] T 81c3873a4eab471da0c19e8bf0eaf03d P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 65, Time since last communication: 0.000s
I20240502 20:45:50.592770 11960 raft_consensus.cc:2932] T 81c3873a4eab471da0c19e8bf0eaf03d P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.67: config changed from index 65 to 67, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 67 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:50.738847 12225 consensus_queue.cc:237] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 1.104, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:50.740657 11699 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 1 index: 105. (index mismatch)
I20240502 20:45:50.741545 13318 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 103, Time since last communication: 0.000s
I20240502 20:45:50.741691 11959 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 1 index: 105. (index mismatch)
I20240502 20:45:50.742348 12094 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 1 index: 105. (index mismatch)
I20240502 20:45:50.742385 11565 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 1 index: 105. (index mismatch)
I20240502 20:45:50.743052 13703 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 103, Time since last communication: 0.000s
I20240502 20:45:50.743230 13318 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 103, Time since last communication: 0.000s
I20240502 20:45:50.743506 13545 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 103, Time since last communication: 0.000s
I20240502 20:45:50.746321 13545 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEADER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:50.747018 11959 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:50.750080 11426 catalog_manager.cc:5484] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: config changed from index -1 to 105, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "72cfad7451c64ef59a18e09d16a79046" committed_config { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:50.753152 11698 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:50.754884 11568 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:50.758765 12093 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:50.794579 11699 consensus_queue.cc:237] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 1.110, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 111 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:50.796603 12225 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 110. Preceding OpId from leader: term: 1 index: 111. (index mismatch)
I20240502 20:45:50.796995 13638 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20240502 20:45:50.797926 11829 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 110. Preceding OpId from leader: term: 1 index: 111. (index mismatch)
I20240502 20:45:50.798303 13638 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20240502 20:45:50.799093 11565 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 110. Preceding OpId from leader: term: 1 index: 111. (index mismatch)
I20240502 20:45:50.800786 13638 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20240502 20:45:50.801225 12092 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 110. Preceding OpId from leader: term: 1 index: 111. (index mismatch)
I20240502 20:45:50.801602 13638 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20240502 20:45:50.802493 13638 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.111: config changed from index -1 to 111, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 111 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:50.803620 11830 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.111: config changed from index -1 to 111, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 111 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:50.805019 12225 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.111: config changed from index -1 to 111, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 111 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:50.805189 12094 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.111: config changed from index -1 to 111, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 111 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:50.806481 11419 catalog_manager.cc:5484] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index -1 to 111, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 111 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:50.806535 11570 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.111: config changed from index -1 to 111, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 111 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
W20240502 20:45:50.841552 12030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.129:36161, user_credentials={real_user=slave}} blocked reactor thread for 48175.8us
W20240502 20:45:50.899757 11636 consensus_peers.cc:485] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 897d8b67ce50427885a7ff494d509b13. This is attempt 1: this message will repeat every 5th retry.
W20240502 20:45:50.989820 12160 consensus_peers.cc:485] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95c74a872c72447cbf6c77beecf8bf1c. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:51.202414 13756 ts_tablet_manager.cc:902] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:45:51.203013 13756 tablet_copy_client.cc:308] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.134:41241
I20240502 20:45:51.247284 12245 tablet_copy_service.cc:140] P 72cfad7451c64ef59a18e09d16a79046: Received BeginTabletCopySession request for tablet 95c74a872c72447cbf6c77beecf8bf1c from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:60847)
I20240502 20:45:51.247447 12245 tablet_copy_service.cc:161] P 72cfad7451c64ef59a18e09d16a79046: Beginning new tablet copy session on tablet 95c74a872c72447cbf6c77beecf8bf1c from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:60847: session id = 8824a7df8ec9431db37c0bb434ede060-95c74a872c72447cbf6c77beecf8bf1c
I20240502 20:45:51.249017 12245 tablet_copy_source_session.cc:205] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:51.250640 13756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c74a872c72447cbf6c77beecf8bf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:51.253295 13756 tablet_copy_client.cc:783] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:51.254925 13756 tablet_copy_client.cc:647] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:51.260728 13756 tablet_copy_client.cc:523] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:51.262408 13756 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:51.396826 13772 ts_tablet_manager.cc:902] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991)
I20240502 20:45:51.410737 13772 tablet_copy_client.cc:308] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:43991
I20240502 20:45:51.441233 11721 tablet_copy_service.cc:140] P 8096a2fe270b492baa3178ad9d2976e7: Received BeginTabletCopySession request for tablet 897d8b67ce50427885a7ff494d509b13 from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:53123)
I20240502 20:45:51.441385 11721 tablet_copy_service.cc:161] P 8096a2fe270b492baa3178ad9d2976e7: Beginning new tablet copy session on tablet 897d8b67ce50427885a7ff494d509b13 from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:53123: session id = 8824a7df8ec9431db37c0bb434ede060-897d8b67ce50427885a7ff494d509b13
I20240502 20:45:51.442516 11721 tablet_copy_source_session.cc:205] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7: Tablet Copy: opened 0 blocks and 1 log segments
W20240502 20:45:51.457466 12030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.132:35493, user_credentials={real_user=slave}} blocked reactor thread for 43568.1us
I20240502 20:45:51.519500 13772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897d8b67ce50427885a7ff494d509b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:51.527630 13772 tablet_copy_client.cc:783] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:51.534529 13772 tablet_copy_client.cc:647] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:51.547511 13772 tablet_copy_client.cc:523] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:51.549613 13772 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:51.653990 13756 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=119 overwritten=0 applied=119 ignored=0} inserts{seen=791 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:51.658324 13756 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:51.658597 13756 ts_tablet_manager.cc:1367] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.396s user 0.113s sys 0.011s
I20240502 20:45:51.659147 13756 raft_consensus.cc:348] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:51.671803 11832 consensus_queue.cc:237] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 1.76, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:51.675803 13756 raft_consensus.cc:729] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:51.676025 13756 consensus_queue.cc:260] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 119, Last appended: 1.119, Last appended by leader: 119, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:51.678274 12223 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 76. Preceding OpId from leader: term: 1 index: 78. (index mismatch)
I20240502 20:45:51.678948 13408 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20240502 20:45:51.679999 13756 ts_tablet_manager.cc:1398] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20240502 20:45:51.682926 12245 tablet_copy_service.cc:342] P 72cfad7451c64ef59a18e09d16a79046: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-95c74a872c72447cbf6c77beecf8bf1c received from {username='slave'} at 127.9.82.135:60847
I20240502 20:45:51.683029 12245 tablet_copy_service.cc:433] P 72cfad7451c64ef59a18e09d16a79046: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-95c74a872c72447cbf6c77beecf8bf1c on tablet 95c74a872c72447cbf6c77beecf8bf1c with peer 8824a7df8ec9431db37c0bb434ede060
I20240502 20:45:51.689075 11701 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 76. Preceding OpId from leader: term: 1 index: 78. (index mismatch)
I20240502 20:45:51.689079 11960 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 76. Preceding OpId from leader: term: 1 index: 78. (index mismatch)
W20240502 20:45:51.694998 11767 consensus_peers.cc:485] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 -> Peer 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): Couldn't send request to peer 8824a7df8ec9431db37c0bb434ede060. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 011b3f9ecb524a54a242425725b72706. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:51.695655 11570 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 76. Preceding OpId from leader: term: 1 index: 78. (index mismatch)
I20240502 20:45:51.719363 13405 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20240502 20:45:51.735832 13405 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
W20240502 20:45:51.776011 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 45064.7us
I20240502 20:45:51.795554 13408 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
W20240502 20:45:51.849566 12030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 54271.4us
I20240502 20:45:51.895169 13772 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=124 overwritten=0 applied=124 ignored=0} inserts{seen=755 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:51.895678 13772 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:51.897886 13772 ts_tablet_manager.cc:1367] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.348s user 0.103s sys 0.015s
I20240502 20:45:51.898451 13772 raft_consensus.cc:348] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 111 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:51.898461 13408 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.77: config changed from index -1 to 77, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:51.898859 13772 raft_consensus.cc:729] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:51.898991 13772 consensus_queue.cc:260] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 124, Last appended: 1.124, Last appended by leader: 124, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 111 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:51.899284 13772 ts_tablet_manager.cc:1398] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:51.900719 12223 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.77: config changed from index -1 to 77, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:51.901665 11417 catalog_manager.cc:5484] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index -1 to 77, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:51.905615 11721 tablet_copy_service.cc:342] P 8096a2fe270b492baa3178ad9d2976e7: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-897d8b67ce50427885a7ff494d509b13 received from {username='slave'} at 127.9.82.135:53123
I20240502 20:45:51.905705 11721 tablet_copy_service.cc:433] P 8096a2fe270b492baa3178ad9d2976e7: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-897d8b67ce50427885a7ff494d509b13 on tablet 897d8b67ce50427885a7ff494d509b13 with peer 8824a7df8ec9431db37c0bb434ede060
I20240502 20:45:51.926792 11570 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.77: config changed from index -1 to 77, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:51.937105 11959 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.77: config changed from index -1 to 77, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:51.940291 11701 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.77: config changed from index -1 to 77, NON_VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) added. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } } }
I20240502 20:45:52.151228 13162 raft_consensus.cc:1203] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.104->[1.105-1.145] Dedup: 1.119->[1.120-1.145]
I20240502 20:45:52.205823 13772 ts_tablet_manager.cc:902] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: Initiating tablet copy from peer 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:45:52.206355 13772 tablet_copy_client.cc:308] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:42315
I20240502 20:45:52.206853 11852 tablet_copy_service.cc:140] P 07fe14e7347a4682bd8f6026ad776da3: Received BeginTabletCopySession request for tablet 011b3f9ecb524a54a242425725b72706 from peer 8824a7df8ec9431db37c0bb434ede060 ({username='slave'} at 127.9.82.135:34397)
I20240502 20:45:52.206967 11852 tablet_copy_service.cc:161] P 07fe14e7347a4682bd8f6026ad776da3: Beginning new tablet copy session on tablet 011b3f9ecb524a54a242425725b72706 from peer 8824a7df8ec9431db37c0bb434ede060 at {username='slave'} at 127.9.82.135:34397: session id = 8824a7df8ec9431db37c0bb434ede060-011b3f9ecb524a54a242425725b72706
I20240502 20:45:52.208098 11852 tablet_copy_source_session.cc:205] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:52.209149 13772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 011b3f9ecb524a54a242425725b72706. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:52.211674 13772 tablet_copy_client.cc:783] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:52.212280 13772 tablet_copy_client.cc:647] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:52.226783 13161 raft_consensus.cc:1203] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.110->[1.111-1.133] Dedup: 1.124->[1.125-1.133]
I20240502 20:45:52.238297 13772 tablet_copy_client.cc:523] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:52.240783 13772 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap starting.
I20240502 20:45:52.284459 13784 raft_consensus.cc:1050] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:52.285132 13784 consensus_queue.cc:237] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 148, Committed index: 148, Last appended: 1.148, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 149 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:52.287617 13162 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 148. Preceding OpId from leader: term: 1 index: 149. (index mismatch)
I20240502 20:45:52.288223 13318 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 149, Last known committed idx: 148, Time since last communication: 0.000s
I20240502 20:45:52.289944 11699 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 148. Preceding OpId from leader: term: 1 index: 149. (index mismatch)
I20240502 20:45:52.289949 12092 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 148. Preceding OpId from leader: term: 1 index: 149. (index mismatch)
I20240502 20:45:52.290484 13784 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 149, Last known committed idx: 148, Time since last communication: 0.000s
I20240502 20:45:52.290736 13784 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 149, Last known committed idx: 148, Time since last communication: 0.000s
I20240502 20:45:52.290879 11962 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 148. Preceding OpId from leader: term: 1 index: 149. (index mismatch)
I20240502 20:45:52.293402 11568 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 148. Preceding OpId from leader: term: 1 index: 149. (index mismatch)
I20240502 20:45:52.295564 13784 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 149, Last known committed idx: 148, Time since last communication: 0.000s
I20240502 20:45:52.297843 13784 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 149, Last known committed idx: 148, Time since last communication: 0.000s
I20240502 20:45:52.300733 13784 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEADER]: Committing config change with OpId 1.149: config changed from index 105 to 149, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 149 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.303711 13148 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.149: config changed from index 105 to 149, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 149 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.304286 11426 catalog_manager.cc:5484] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: config changed from index 105 to 149, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "72cfad7451c64ef59a18e09d16a79046" committed_config { opid_index: 149 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:52.308764 11701 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.149: config changed from index 105 to 149, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 149 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.310346 12094 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.149: config changed from index 105 to 149, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 149 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.367008 11570 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.149: config changed from index 105 to 149, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 149 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.369853 11960 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.149: config changed from index 105 to 149, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 149 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.381871 12223 consensus_queue.cc:237] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 150, Committed index: 150, Last appended: 1.150, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 151 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:52.384241 12092 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 150. Preceding OpId from leader: term: 1 index: 151. (index mismatch)
I20240502 20:45:52.389070 13146 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 150. Preceding OpId from leader: term: 1 index: 151. (index mismatch)
I20240502 20:45:52.392020 13784 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 151, Last known committed idx: 149, Time since last communication: 0.000s
I20240502 20:45:52.395659 11565 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 150. Preceding OpId from leader: term: 1 index: 151. (index mismatch)
I20240502 20:45:52.396530 11960 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 150. Preceding OpId from leader: term: 1 index: 151. (index mismatch)
I20240502 20:45:52.399844 13784 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 151, Last known committed idx: 150, Time since last communication: 0.000s
I20240502 20:45:52.401086 13638 raft_consensus.cc:1050] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:52.401573 13638 consensus_queue.cc:237] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 1.134, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:52.404489 11565 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 134. Preceding OpId from leader: term: 1 index: 135. (index mismatch)
I20240502 20:45:52.404623 12222 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 134. Preceding OpId from leader: term: 1 index: 135. (index mismatch)
I20240502 20:45:52.405016 13447 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20240502 20:45:52.406294 11832 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 134. Preceding OpId from leader: term: 1 index: 135. (index mismatch)
I20240502 20:45:52.406746 13447 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20240502 20:45:52.408243 13447 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20240502 20:45:52.409359 13146 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 134. Preceding OpId from leader: term: 1 index: 135. (index mismatch)
I20240502 20:45:52.410552 12092 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 134. Preceding OpId from leader: term: 1 index: 135. (index mismatch)
I20240502 20:45:52.411091 13730 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20240502 20:45:52.411585 13730 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.135: config changed from index 111 to 135, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.412312 13301 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20240502 20:45:52.415148 13146 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.135: config changed from index 111 to 135, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.415323 11422 catalog_manager.cc:5484] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index 111 to 135, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:52.418200 12093 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.135: config changed from index 111 to 135, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.421415 11829 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.135: config changed from index 111 to 135, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.424322 11565 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.135: config changed from index 111 to 135, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.435217 12223 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.135: config changed from index 111 to 135, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 135 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.450152 13318 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 151, Last known committed idx: 150, Time since last communication: 0.000s
I20240502 20:45:52.454890 13669 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 151, Last known committed idx: 149, Time since last communication: 0.000s
I20240502 20:45:52.463263 13773 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEADER]: Committing config change with OpId 1.151: config changed from index 149 to 151, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 151 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.466032 11411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 95c74a872c72447cbf6c77beecf8bf1c with cas_config_opid_index 149: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:52.466248 13146 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.151: config changed from index 149 to 151, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 151 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.466907 11422 catalog_manager.cc:5484] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: config changed from index 149 to 151, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "72cfad7451c64ef59a18e09d16a79046" committed_config { opid_index: 151 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:45:52.471542 11680 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c74a872c72447cbf6c77beecf8bf1c with delete_type TABLET_DATA_TOMBSTONED (TS 8096a2fe270b492baa3178ad9d2976e7 not found in new config with opid_index 151) from {username='slave'} at 127.0.0.1:40458
I20240502 20:45:52.472951 12092 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.151: config changed from index 149 to 151, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 151 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.482991 11565 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.151: config changed from index 149 to 151, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 151 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.483070 11959 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.151: config changed from index 149 to 151, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 151 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.534147 13836 tablet_replica.cc:330] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7: stopping tablet replica
I20240502 20:45:52.534869 13836 raft_consensus.cc:2229] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:52.535490 13836 raft_consensus.cc:2258] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:52.549799 13836 ts_tablet_manager.cc:1875] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:52.587316 13836 ts_tablet_manager.cc:1888] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.150
I20240502 20:45:52.587437 13836 log.cc:1196] T 95c74a872c72447cbf6c77beecf8bf1c P 8096a2fe270b492baa3178ad9d2976e7: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/95c74a872c72447cbf6c77beecf8bf1c
I20240502 20:45:52.588236 11413 catalog_manager.cc:4830] TS 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991): tablet 95c74a872c72447cbf6c77beecf8bf1c (table rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]) successfully deleted
I20240502 20:45:52.671515 11701 consensus_queue.cc:237] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 136, Committed index: 136, Last appended: 1.136, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 137 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:52.706321 12225 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 136. Preceding OpId from leader: term: 1 index: 137. (index mismatch)
I20240502 20:45:52.707994 13447 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 137, Last known committed idx: 136, Time since last communication: 0.000s
I20240502 20:45:52.709055 12094 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 136. Preceding OpId from leader: term: 1 index: 137. (index mismatch)
I20240502 20:45:52.715384 13730 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 137, Last known committed idx: 136, Time since last communication: 0.000s
I20240502 20:45:52.718232 13161 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 136. Preceding OpId from leader: term: 1 index: 137. (index mismatch)
I20240502 20:45:52.720223 12940 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 137, Last known committed idx: 135, Time since last communication: 0.000s
I20240502 20:45:52.720448 13638 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.137: config changed from index 135 to 137, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 137 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.720731 11832 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 136. Preceding OpId from leader: term: 1 index: 137. (index mismatch)
I20240502 20:45:52.723464 11419 catalog_manager.cc:5484] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index 135 to 137, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 137 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:52.726987 11549 tablet_service.cc:1514] Processing DeleteTablet for tablet 897d8b67ce50427885a7ff494d509b13 with delete_type TABLET_DATA_TOMBSTONED (TS 5521e131639043f8b116f9c71cf4bfee not found in new config with opid_index 137) from {username='slave'} at 127.0.0.1:60196
I20240502 20:45:52.727751 13447 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 137, Last known committed idx: 136, Time since last communication: 0.000s
I20240502 20:45:52.729808 11829 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.137: config changed from index 135 to 137, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 137 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.730453 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 897d8b67ce50427885a7ff494d509b13 with cas_config_opid_index 135: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:52.731776 12221 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.137: config changed from index 135 to 137, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 137 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.736375 12093 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.137: config changed from index 135 to 137, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 137 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.775874 13856 tablet_replica.cc:330] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee: stopping tablet replica
I20240502 20:45:52.776122 13856 raft_consensus.cc:2229] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:52.776371 13856 raft_consensus.cc:2258] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:52.777647 13148 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.137: config changed from index 135 to 137, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 137 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:52.791616 13856 ts_tablet_manager.cc:1875] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:52.805758 13856 ts_tablet_manager.cc:1888] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.136
I20240502 20:45:52.805970 13856 log.cc:1196] T 897d8b67ce50427885a7ff494d509b13 P 5521e131639043f8b116f9c71cf4bfee: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/897d8b67ce50427885a7ff494d509b13
I20240502 20:45:52.824702 11413 catalog_manager.cc:4830] TS 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161): tablet 897d8b67ce50427885a7ff494d509b13 (table rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]) successfully deleted
W20240502 20:45:52.957047 13772 log.cc:924] Time spent T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20240502 20:45:53.096204 13772 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap replayed 1/1 log segments. Stats: ops{read=82 overwritten=0 applied=82 ignored=0} inserts{seen=767 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:53.098426 13772 tablet_bootstrap.cc:492] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: Bootstrap complete.
I20240502 20:45:53.098829 13772 ts_tablet_manager.cc:1367] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: Time spent bootstrapping tablet: real 0.858s user 0.086s sys 0.004s
I20240502 20:45:53.099486 13772 raft_consensus.cc:348] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:53.099748 13772 raft_consensus.cc:729] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8824a7df8ec9431db37c0bb434ede060, State: Initialized, Role: LEARNER
I20240502 20:45:53.099957 13772 consensus_queue.cc:260] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 82, Last appended: 1.82, Last appended by leader: 82, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: true } }
I20240502 20:45:53.100430 13772 ts_tablet_manager.cc:1398] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:45:53.100993 11852 tablet_copy_service.cc:342] P 07fe14e7347a4682bd8f6026ad776da3: Request end of tablet copy session 8824a7df8ec9431db37c0bb434ede060-011b3f9ecb524a54a242425725b72706 received from {username='slave'} at 127.9.82.135:34397
I20240502 20:45:53.101092 11852 tablet_copy_service.cc:433] P 07fe14e7347a4682bd8f6026ad776da3: ending tablet copy session 8824a7df8ec9431db37c0bb434ede060-011b3f9ecb524a54a242425725b72706 on tablet 011b3f9ecb524a54a242425725b72706 with peer 8824a7df8ec9431db37c0bb434ede060
I20240502 20:45:53.292161 13146 raft_consensus.cc:1203] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.76->[1.77-1.93] Dedup: 1.82->[1.83-1.93]
I20240502 20:45:53.368661 13408 raft_consensus.cc:1050] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3: attempting to promote NON_VOTER 8824a7df8ec9431db37c0bb434ede060 to VOTER
I20240502 20:45:53.369114 13408 consensus_queue.cc:237] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 1.95, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:53.371043 13161 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060 [term 1 LEARNER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 95. Preceding OpId from leader: term: 1 index: 96. (index mismatch)
I20240502 20:45:53.373195 13850 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 94, Time since last communication: 0.000s
I20240502 20:45:53.378234 12224 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 95. Preceding OpId from leader: term: 1 index: 96. (index mismatch)
I20240502 20:45:53.379330 13408 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 94, Time since last communication: 0.000s
I20240502 20:45:53.403788 11700 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 95. Preceding OpId from leader: term: 1 index: 96. (index mismatch)
I20240502 20:45:53.406291 11963 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 95. Preceding OpId from leader: term: 1 index: 96. (index mismatch)
I20240502 20:45:53.407009 11566 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 95. Preceding OpId from leader: term: 1 index: 96. (index mismatch)
I20240502 20:45:53.465497 13850 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 94, Time since last communication: 0.000s
I20240502 20:45:53.465709 13591 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 94, Time since last communication: 0.000s
I20240502 20:45:53.531142 13850 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 94, Time since last communication: 0.000s
I20240502 20:45:53.573246 13852 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.96: config changed from index 77 to 96, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.578176 11422 catalog_manager.cc:5484] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 77 to 96, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:45:53.578806 13163 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.96: config changed from index 77 to 96, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.599375 12224 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.96: config changed from index 77 to 96, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.618592 11568 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.96: config changed from index 77 to 96, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.636675 11701 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.96: config changed from index 77 to 96, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.642932 11959 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.96: config changed from index 77 to 96, 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 96 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.715643 11832 consensus_queue.cc:237] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 1.98, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } }
I20240502 20:45:53.717586 13160 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 98. Preceding OpId from leader: term: 1 index: 99. (index mismatch)
I20240502 20:45:53.718078 11958 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 98. Preceding OpId from leader: term: 1 index: 99. (index mismatch)
I20240502 20:45:53.718370 13852 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 97, Time since last communication: 0.000s
I20240502 20:45:53.718952 11701 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 98. Preceding OpId from leader: term: 1 index: 99. (index mismatch)
I20240502 20:45:53.719019 11566 raft_consensus.cc:1261] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 98. Preceding OpId from leader: term: 1 index: 99. (index mismatch)
I20240502 20:45:53.719507 13852 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20240502 20:45:53.722187 13803 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20240502 20:45:53.723276 13803 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.99: config changed from index 96 to 99, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.725559 11411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 011b3f9ecb524a54a242425725b72706 with cas_config_opid_index 96: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:53.725678 11566 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.99: config changed from index 96 to 99, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.726284 11417 catalog_manager.cc:5484] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 96 to 99, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:45:53.726611 11963 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.99: config changed from index 96 to 99, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.727432 13146 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.99: config changed from index 96 to 99, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.732674 13844 consensus_queue.cc:1035] T 011b3f9ecb524a54a242425725b72706 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20240502 20:45:53.734480 12205 tablet_service.cc:1514] Processing DeleteTablet for tablet 011b3f9ecb524a54a242425725b72706 with delete_type TABLET_DATA_TOMBSTONED (TS 72cfad7451c64ef59a18e09d16a79046 not found in new config with opid_index 99) from {username='slave'} at 127.0.0.1:36220
I20240502 20:45:53.740280 13902 tablet_replica.cc:330] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: stopping tablet replica
I20240502 20:45:53.740511 13902 raft_consensus.cc:2229] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:53.740655 13902 pending_rounds.cc:62] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: Trying to abort 1 pending ops.
I20240502 20:45:53.740746 13902 pending_rounds.cc:68] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: Aborting op as it isn't in flight: id { term: 1 index: 98 } timestamp: 7023340559110709248 op_type: WRITE_OP write_request { tablet_id: "011b3f9ecb524a54a242425725b72706" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000B\220Ma\245N\254p\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""5c63c48fb3fb6f58" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023340558656462848 authz_token { token_data: "\010\244\371\317\261\006\"3\n\005slave\022*\n 0e9e71c37052426984ffcf96e6056d2c\020\001\030\001 \001(\001" signature: "<redacted>""\nn7\356\356\234t\371\320\242{;\255\250u;\21006_VF~\002\261\233=\003\002\205[\007B\355{\352\254\277\263\254\317XC\033V3,N\306\355\020`\312\243\254\205\027\205\333\366\216Ck\\" signing_key_seq_num: 0 } } request_id { client_id: "6a116c30dc614d4285af8671cb0dc170" seq_no: 287 first_incomplete_seq_no: 287 attempt_no: 0 }
I20240502 20:45:53.742519 13902 raft_consensus.cc:2258] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:53.744246 13902 ts_tablet_manager.cc:1875] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:53.744647 11700 raft_consensus.cc:2932] T 011b3f9ecb524a54a242425725b72706 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.99: config changed from index 96 to 99, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } }
I20240502 20:45:53.750013 13902 ts_tablet_manager.cc:1888] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.98
I20240502 20:45:53.750174 13902 log.cc:1196] T 011b3f9ecb524a54a242425725b72706 P 72cfad7451c64ef59a18e09d16a79046: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/wals/011b3f9ecb524a54a242425725b72706
I20240502 20:45:53.750854 11411 catalog_manager.cc:4830] TS 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241): tablet 011b3f9ecb524a54a242425725b72706 (table rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]) successfully deleted
W20240502 20:45:53.954365 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 43638.1us
I20240502 20:45:54.898741 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:45:54.916527 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:54.976568 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:45:54.981755 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:45:54.989075 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:54.991899 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:55.035921 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:45:55.570381 11963 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 165, Committed index: 165, Last appended: 1.166, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 167 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: true } }
W20240502 20:45:55.572969 11899 consensus_peers.cc:485] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf -> Peer 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991): Couldn't send request to peer 8096a2fe270b492baa3178ad9d2976e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a2169943b994152ba495bdb810754a0. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:55.573506 11828 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 166. Preceding OpId from leader: term: 1 index: 167. (index mismatch)
I20240502 20:45:55.574298 13855 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 167, Last known committed idx: 165, Time since last communication: 0.000s
I20240502 20:45:55.575647 13160 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 165. Preceding OpId from leader: term: 1 index: 167. (index mismatch)
I20240502 20:45:55.576690 11563 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 166. Preceding OpId from leader: term: 1 index: 167. (index mismatch)
I20240502 20:45:55.578023 13857 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 167, Last known committed idx: 165, Time since last communication: 0.000s
I20240502 20:45:55.583781 12224 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 165. Preceding OpId from leader: term: 1 index: 167. (index mismatch)
I20240502 20:45:55.585170 13857 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 167, Last known committed idx: 165, Time since last communication: 0.000s
I20240502 20:45:55.588778 13857 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 167, Last known committed idx: 165, Time since last communication: 0.000s
I20240502 20:45:55.589761 12220 raft_consensus.cc:1203] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.165->[1.166-1.166] Dedup: 1.166->[]
I20240502 20:45:55.590691 13163 raft_consensus.cc:1203] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.165->[1.166-1.167] Dedup: 1.166->[1.167-1.167]
I20240502 20:45:55.591881 12917 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.167: config changed from index 42 to 167, NON_VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) added. New config: { opid_index: 167 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: true } } }
I20240502 20:45:55.595470 11425 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index 42 to 167, NON_VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) added. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 167 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:55.611403 12224 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.167: config changed from index 42 to 167, NON_VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) added. New config: { opid_index: 167 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: true } } }
I20240502 20:45:55.619239 11570 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.167: config changed from index 42 to 167, NON_VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) added. New config: { opid_index: 167 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: true } } }
I20240502 20:45:55.621685 11829 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.167: config changed from index 42 to 167, NON_VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) added. New config: { opid_index: 167 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: true } } }
I20240502 20:45:55.645982 11963 consensus_queue.cc:237] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 173, Committed index: 173, Last appended: 1.173, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: true } }
W20240502 20:45:55.649263 11899 consensus_peers.cc:485] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf -> Peer 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161): Couldn't send request to peer 5521e131639043f8b116f9c71cf4bfee. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7261de9012914524a7c43551687fdc0b. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:45:55.649618 11828 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 173. Preceding OpId from leader: term: 1 index: 174. (index mismatch)
I20240502 20:45:55.651379 12220 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 173. Preceding OpId from leader: term: 1 index: 174. (index mismatch)
I20240502 20:45:55.652643 13857 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 174, Last known committed idx: 173, Time since last communication: 0.000s
I20240502 20:45:55.653043 13857 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 174, Last known committed idx: 173, Time since last communication: 0.000s
I20240502 20:45:55.657670 13857 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.174: config changed from index 65 to 174, NON_VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) added. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: true } } }
I20240502 20:45:55.658787 12090 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 173. Preceding OpId from leader: term: 1 index: 174. (index mismatch)
I20240502 20:45:55.661748 11828 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.174: config changed from index 65 to 174, NON_VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) added. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: true } } }
I20240502 20:45:55.663122 13161 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 173. Preceding OpId from leader: term: 1 index: 174. (index mismatch)
W20240502 20:45:55.663457 12161 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.129:36161, user_credentials={real_user=slave}} blocked reactor thread for 72316.8us
I20240502 20:45:55.664059 13148 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.167: config changed from index 42 to 167, NON_VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) added. New config: { opid_index: 167 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: true } } }
I20240502 20:45:55.675031 13858 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 174, Last known committed idx: 173, Time since last communication: 0.000s
I20240502 20:45:55.675381 13855 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 174, Last known committed idx: 173, Time since last communication: 0.000s
I20240502 20:45:55.686295 12222 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.174: config changed from index 65 to 174, NON_VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) added. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: true } } }
I20240502 20:45:55.704159 13160 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.174: config changed from index 65 to 174, NON_VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) added. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: true } } }
I20240502 20:45:55.735802 11426 catalog_manager.cc:5484] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index 65 to 174, NON_VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) added. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:45:55.739197 12094 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.174: config changed from index 65 to 174, NON_VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) added. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: true } } }
I20240502 20:45:56.220558 14019 ts_tablet_manager.cc:902] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: Initiating tablet copy from peer 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493)
I20240502 20:45:56.221529 14019 tablet_copy_client.cc:308] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:35493
I20240502 20:45:56.224328 11983 tablet_copy_service.cc:140] P 6529b03451c9475ab62c51f71714b0cf: Received BeginTabletCopySession request for tablet 8a2169943b994152ba495bdb810754a0 from peer 8096a2fe270b492baa3178ad9d2976e7 ({username='slave'} at 127.9.82.130:48159)
I20240502 20:45:56.224467 11983 tablet_copy_service.cc:161] P 6529b03451c9475ab62c51f71714b0cf: Beginning new tablet copy session on tablet 8a2169943b994152ba495bdb810754a0 from peer 8096a2fe270b492baa3178ad9d2976e7 at {username='slave'} at 127.9.82.130:48159: session id = 8096a2fe270b492baa3178ad9d2976e7-8a2169943b994152ba495bdb810754a0
I20240502 20:45:56.225564 11983 tablet_copy_source_session.cc:205] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:56.277140 14030 ts_tablet_manager.cc:902] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: Initiating tablet copy from peer 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493)
I20240502 20:45:56.279429 14030 tablet_copy_client.cc:308] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:35493
W20240502 20:45:56.282804 12030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 46315.2us
I20240502 20:45:56.288555 14019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2169943b994152ba495bdb810754a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:56.301642 14019 tablet_copy_client.cc:783] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:56.302037 14019 tablet_copy_client.cc:647] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:56.310115 14019 tablet_copy_client.cc:523] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:56.318158 14019 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap starting.
I20240502 20:45:56.389637 11983 tablet_copy_service.cc:140] P 6529b03451c9475ab62c51f71714b0cf: Received BeginTabletCopySession request for tablet 7261de9012914524a7c43551687fdc0b from peer 5521e131639043f8b116f9c71cf4bfee ({username='slave'} at 127.9.82.129:36207)
I20240502 20:45:56.389765 11983 tablet_copy_service.cc:161] P 6529b03451c9475ab62c51f71714b0cf: Beginning new tablet copy session on tablet 7261de9012914524a7c43551687fdc0b from peer 5521e131639043f8b116f9c71cf4bfee at {username='slave'} at 127.9.82.129:36207: session id = 5521e131639043f8b116f9c71cf4bfee-7261de9012914524a7c43551687fdc0b
I20240502 20:45:56.390836 11983 tablet_copy_source_session.cc:205] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:45:56.392877 14030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7261de9012914524a7c43551687fdc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:45:56.396425 14030 tablet_copy_client.cc:783] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: tablet copy: Starting download of 0 data blocks...
I20240502 20:45:56.396701 14030 tablet_copy_client.cc:647] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: tablet copy: Starting download of 1 WAL segments...
I20240502 20:45:56.412194 14030 tablet_copy_client.cc:523] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:45:56.414574 14030 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: Bootstrap starting.
I20240502 20:45:56.835304 14019 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=179 overwritten=0 applied=179 ignored=0} inserts{seen=861 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:56.835923 14019 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: Bootstrap complete.
I20240502 20:45:56.838544 14019 ts_tablet_manager.cc:1367] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: Time spent bootstrapping tablet: real 0.520s user 0.145s sys 0.023s
I20240502 20:45:56.839463 14019 raft_consensus.cc:348] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 167 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: true } }
I20240502 20:45:56.839754 14019 raft_consensus.cc:729] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8096a2fe270b492baa3178ad9d2976e7, State: Initialized, Role: LEARNER
I20240502 20:45:56.840844 14019 consensus_queue.cc:260] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 179, Last appended: 1.179, Last appended by leader: 179, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 167 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: true } }
I20240502 20:45:56.844997 14019 ts_tablet_manager.cc:1398] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20240502 20:45:56.852144 11983 tablet_copy_service.cc:342] P 6529b03451c9475ab62c51f71714b0cf: Request end of tablet copy session 8096a2fe270b492baa3178ad9d2976e7-8a2169943b994152ba495bdb810754a0 received from {username='slave'} at 127.9.82.130:48159
I20240502 20:45:56.852262 11983 tablet_copy_service.cc:433] P 6529b03451c9475ab62c51f71714b0cf: ending tablet copy session 8096a2fe270b492baa3178ad9d2976e7-8a2169943b994152ba495bdb810754a0 on tablet 8a2169943b994152ba495bdb810754a0 with peer 8096a2fe270b492baa3178ad9d2976e7
W20240502 20:45:56.865801 12030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.129:36161, user_credentials={real_user=slave}} blocked reactor thread for 97555.7us
I20240502 20:45:57.007457 14030 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=868 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:45:57.007992 14030 tablet_bootstrap.cc:492] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: Bootstrap complete.
I20240502 20:45:57.008296 14030 ts_tablet_manager.cc:1367] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: Time spent bootstrapping tablet: real 0.594s user 0.160s sys 0.010s
I20240502 20:45:57.008845 14030 raft_consensus.cc:348] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: true } }
I20240502 20:45:57.009086 14030 raft_consensus.cc:729] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5521e131639043f8b116f9c71cf4bfee, State: Initialized, Role: LEARNER
I20240502 20:45:57.009270 14030 consensus_queue.cc:260] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 1.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: true } }
I20240502 20:45:57.009796 14030 ts_tablet_manager.cc:1398] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:45:57.010417 11983 tablet_copy_service.cc:342] P 6529b03451c9475ab62c51f71714b0cf: Request end of tablet copy session 5521e131639043f8b116f9c71cf4bfee-7261de9012914524a7c43551687fdc0b received from {username='slave'} at 127.9.82.129:36207
I20240502 20:45:57.010510 11983 tablet_copy_service.cc:433] P 6529b03451c9475ab62c51f71714b0cf: ending tablet copy session 5521e131639043f8b116f9c71cf4bfee-7261de9012914524a7c43551687fdc0b on tablet 7261de9012914524a7c43551687fdc0b with peer 5521e131639043f8b116f9c71cf4bfee
I20240502 20:45:57.050490 11698 raft_consensus.cc:1203] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.166->[1.167-1.190] Dedup: 1.179->[1.180-1.190]
I20240502 20:45:57.086354 12917 raft_consensus.cc:1050] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: attempting to promote NON_VOTER 8096a2fe270b492baa3178ad9d2976e7 to VOTER
I20240502 20:45:57.086901 12917 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 192 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } }
I20240502 20:45:57.089198 11698 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEARNER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 191. Preceding OpId from leader: term: 1 index: 192. (index mismatch)
I20240502 20:45:57.090314 13983 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 192, Last known committed idx: 191, Time since last communication: 0.000s
I20240502 20:45:57.092036 12223 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 191. Preceding OpId from leader: term: 1 index: 192. (index mismatch)
I20240502 20:45:57.092159 11829 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 191. Preceding OpId from leader: term: 1 index: 192. (index mismatch)
I20240502 20:45:57.092748 14000 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 192, Last known committed idx: 191, Time since last communication: 0.000s
I20240502 20:45:57.093048 14000 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 192, Last known committed idx: 191, Time since last communication: 0.000s
I20240502 20:45:57.095990 14000 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.192: config changed from index 167 to 192, 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 192 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.099661 12223 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.192: config changed from index 167 to 192, 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 192 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.100185 11829 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.192: config changed from index 167 to 192, 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 192 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.100528 11700 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.192: config changed from index 167 to 192, 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 192 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.103855 11417 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: config changed from index 167 to 192, 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 192 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.103691 11563 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 191. Preceding OpId from leader: term: 1 index: 192. (index mismatch)
I20240502 20:45:57.106791 13983 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 192, Last known committed idx: 191, Time since last communication: 0.000s
I20240502 20:45:57.108031 11567 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.192: config changed from index 167 to 192, 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 192 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
W20240502 20:45:57.115129 12161 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.133:33233, user_credentials={real_user=slave}} blocked reactor thread for 53735.1us
I20240502 20:45:57.116721 13160 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 191. Preceding OpId from leader: term: 1 index: 192. (index mismatch)
I20240502 20:45:57.117280 13983 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 192, Last known committed idx: 190, Time since last communication: 0.000s
I20240502 20:45:57.118281 13160 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.192: config changed from index 167 to 192, 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 192 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.158260 11963 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 194 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } }
I20240502 20:45:57.159762 11563 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 193. Preceding OpId from leader: term: 1 index: 194. (index mismatch)
I20240502 20:45:57.160162 11698 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 193. Preceding OpId from leader: term: 1 index: 194. (index mismatch)
I20240502 20:45:57.160588 12224 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 193. Preceding OpId from leader: term: 1 index: 194. (index mismatch)
I20240502 20:45:57.161686 14000 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 194, Last known committed idx: 192, Time since last communication: 0.000s
I20240502 20:45:57.176789 12917 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 194, Last known committed idx: 193, Time since last communication: 0.000s
I20240502 20:45:57.181900 13162 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 193. Preceding OpId from leader: term: 1 index: 194. (index mismatch)
I20240502 20:45:57.181872 12917 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.194: config changed from index 192 to 194, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 194 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.185127 11421 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index 192 to 194, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 194 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:45:57.185132 11700 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.194: config changed from index 192 to 194, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 194 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.189014 11810 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a2169943b994152ba495bdb810754a0 with delete_type TABLET_DATA_TOMBSTONED (TS 07fe14e7347a4682bd8f6026ad776da3 not found in new config with opid_index 194) from {username='slave'} at 127.0.0.1:39248
I20240502 20:45:57.189399 12220 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.194: config changed from index 192 to 194, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 194 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.197088 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8a2169943b994152ba495bdb810754a0 with cas_config_opid_index 192: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:57.198375 12917 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 194, Last known committed idx: 192, Time since last communication: 0.000s
I20240502 20:45:57.206430 13146 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.194: config changed from index 192 to 194, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 194 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.224606 14058 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 194, Last known committed idx: 193, Time since last communication: 0.000s
I20240502 20:45:57.225910 11563 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.194: config changed from index 192 to 194, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 194 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } }
I20240502 20:45:57.302191 14071 tablet_replica.cc:330] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3: stopping tablet replica
I20240502 20:45:57.302568 14071 raft_consensus.cc:2229] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:57.303043 11565 raft_consensus.cc:1203] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee [term 1 LEARNER]: Deduplicated request from leader. Original: 1.173->[1.174-1.195] Dedup: 1.186->[1.187-1.195]
I20240502 20:45:57.305341 14071 raft_consensus.cc:2258] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:57.313361 14071 ts_tablet_manager.cc:1875] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:57.362704 14071 ts_tablet_manager.cc:1888] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.193
I20240502 20:45:57.363063 14071 log.cc:1196] T 8a2169943b994152ba495bdb810754a0 P 07fe14e7347a4682bd8f6026ad776da3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/8a2169943b994152ba495bdb810754a0
I20240502 20:45:57.364229 11411 catalog_manager.cc:4830] TS 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315): tablet 8a2169943b994152ba495bdb810754a0 (table rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]) successfully deleted
I20240502 20:45:57.445698 13983 raft_consensus.cc:1050] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf: attempting to promote NON_VOTER 5521e131639043f8b116f9c71cf4bfee to VOTER
I20240502 20:45:57.446130 13983 consensus_queue.cc:237] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 196, Committed index: 196, Last appended: 1.196, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } }
I20240502 20:45:57.448840 11569 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee [term 1 LEARNER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 196. Preceding OpId from leader: term: 1 index: 197. (index mismatch)
I20240502 20:45:57.449723 13858 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 197, Last known committed idx: 195, Time since last communication: 0.000s
I20240502 20:45:57.450500 11828 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 196. Preceding OpId from leader: term: 1 index: 197. (index mismatch)
I20240502 20:45:57.451925 13857 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 197, Last known committed idx: 196, Time since last communication: 0.000s
I20240502 20:45:57.457283 12220 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 196. Preceding OpId from leader: term: 1 index: 197. (index mismatch)
I20240502 20:45:57.461464 12090 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 196. Preceding OpId from leader: term: 1 index: 197. (index mismatch)
I20240502 20:45:57.469770 14057 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 197, Last known committed idx: 195, Time since last communication: 0.000s
I20240502 20:45:57.472908 14057 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 197, Last known committed idx: 195, Time since last communication: 0.000s
I20240502 20:45:57.475768 13161 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 196. Preceding OpId from leader: term: 1 index: 197. (index mismatch)
I20240502 20:45:57.476369 13857 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.197: config changed from index 174 to 197, 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.480976 13858 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 197, Last known committed idx: 196, Time since last communication: 0.000s
I20240502 20:45:57.481122 11421 catalog_manager.cc:5484] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index 174 to 197, 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:45:57.484336 11563 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.197: config changed from index 174 to 197, 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.488175 13161 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.197: config changed from index 174 to 197, 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.492370 12094 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.197: config changed from index 174 to 197, 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.499184 11828 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.197: config changed from index 174 to 197, 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.545814 11960 consensus_queue.cc:237] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 198, Committed index: 198, Last appended: 1.198, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 199 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } }
I20240502 20:45:57.548403 11567 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 198. Preceding OpId from leader: term: 1 index: 199. (index mismatch)
I20240502 20:45:57.548923 13983 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 199, Last known committed idx: 197, Time since last communication: 0.000s
I20240502 20:45:57.553391 11828 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 198. Preceding OpId from leader: term: 1 index: 199. (index mismatch)
I20240502 20:45:57.553915 13983 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 199, Last known committed idx: 197, Time since last communication: 0.000s
I20240502 20:45:57.556630 13983 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.199: config changed from index 197 to 199, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 199 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.560468 11829 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.199: config changed from index 197 to 199, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 199 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.560698 11569 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.199: config changed from index 197 to 199, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 199 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.565879 11425 catalog_manager.cc:5484] T 7261de9012914524a7c43551687fdc0b P 5521e131639043f8b116f9c71cf4bfee reported cstate change: config changed from index 197 to 199, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 199 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.566020 12224 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.197: config changed from index 174 to 197, 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.574877 12224 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 198. Preceding OpId from leader: term: 1 index: 199. (index mismatch)
I20240502 20:45:57.582618 13146 raft_consensus.cc:1261] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 198. Preceding OpId from leader: term: 1 index: 199. (index mismatch)
I20240502 20:45:57.590704 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 7261de9012914524a7c43551687fdc0b with cas_config_opid_index 197: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:45:57.593853 13857 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 199, Last known committed idx: 197, Time since last communication: 0.000s
I20240502 20:45:57.600086 14057 consensus_queue.cc:1035] T 7261de9012914524a7c43551687fdc0b P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 199, Last known committed idx: 198, Time since last communication: 0.000s
I20240502 20:45:57.605783 12222 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.199: config changed from index 197 to 199, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 199 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.607265 13161 raft_consensus.cc:2932] T 7261de9012914524a7c43551687fdc0b P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.199: config changed from index 197 to 199, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 199 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { promote: false } } }
I20240502 20:45:57.638540 12073 tablet_service.cc:1514] Processing DeleteTablet for tablet 7261de9012914524a7c43551687fdc0b with delete_type TABLET_DATA_TOMBSTONED (TS 7dd8e38181f24e349fb179d2a9eb74c1 not found in new config with opid_index 199) from {username='slave'} at 127.0.0.1:51414
W20240502 20:45:57.653988 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.132:35493, user_credentials={real_user=slave}} blocked reactor thread for 50667.1us
I20240502 20:45:57.656970 14086 tablet_replica.cc:330] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1: stopping tablet replica
I20240502 20:45:57.657276 14086 raft_consensus.cc:2229] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:45:57.657584 14086 raft_consensus.cc:2258] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:45:57.659132 14086 ts_tablet_manager.cc:1875] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:45:57.685642 14086 ts_tablet_manager.cc:1888] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.198
I20240502 20:45:57.685875 14086 log.cc:1196] T 7261de9012914524a7c43551687fdc0b P 7dd8e38181f24e349fb179d2a9eb74c1: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/7261de9012914524a7c43551687fdc0b
I20240502 20:45:57.693058 11413 catalog_manager.cc:4830] TS 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233): tablet 7261de9012914524a7c43551687fdc0b (table rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]) successfully deleted
W20240502 20:45:57.804920 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.129:36161, user_credentials={real_user=slave}} blocked reactor thread for 49485us
W20240502 20:45:57.809913 12030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 49616.6us
W20240502 20:45:57.940591 12030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 46320.4us
I20240502 20:45:58.089196 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:45:58.093660 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:45:58.102312 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:58.133901 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20240502 20:45:58.140830 12161 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 50255.4us
W20240502 20:45:58.150157 12030 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.130:43991, user_credentials={real_user=slave}} blocked reactor thread for 49755.3us
I20240502 20:45:58.182948 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:45:58.198688 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:58.323436 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:45:59.108104 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:59.111394 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:45:59.111441 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:45:59.114621 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:45:59.129900 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:45:59.173615 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:45:59.286476 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
W20240502 20:45:59.416453 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.129:36161, user_credentials={real_user=slave}} blocked reactor thread for 54073.1us
W20240502 20:45:59.657716 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.129:36161, user_credentials={real_user=slave}} blocked reactor thread for 56650.2us
W20240502 20:46:00.054512 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.133:33233, user_credentials={real_user=slave}} blocked reactor thread for 48600.7us
I20240502 20:46:00.769425 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20240502 20:46:00.784107 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.129:36161, user_credentials={real_user=slave}} blocked reactor thread for 56475.9us
I20240502 20:46:00.790498 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:00.826967 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:00.828855 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:00.859483 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:46:00.887713 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:01.003528 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:01.966452 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:01.979444 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:46:02.013197 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:02.150820 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:02.172482 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:02.192709 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:02.196605 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
W20240502 20:46:02.559150 12161 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.133:33233, user_credentials={real_user=slave}} blocked reactor thread for 48820.9us
W20240502 20:46:02.935122 11768 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.82.129:36161, user_credentials={real_user=slave}} blocked reactor thread for 44652.9us
I20240502 20:46:03.201683 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:03.202083 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:03.203415 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:46:03.215137 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:03.220124 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:03.229840 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:03.231880 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
5386a2faaac64ec7b5ca5c0b90daa78b | 127.9.82.190:43461 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
allow_unsafe_replication_factor | true | runtime,unsafe | all 1 server(s) checked
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+--------------------+-------------------------
builtin_ntp_servers | 127.9.82.148:40229 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
07fe14e7347a4682bd8f6026ad776da3 | 127.9.82.131:42315 | HEALTHY | <none> | 5 | 0
5521e131639043f8b116f9c71cf4bfee | 127.9.82.129:36161 | HEALTHY | <none> | 0 | 0
6529b03451c9475ab62c51f71714b0cf | 127.9.82.132:35493 | HEALTHY | <none> | 2 | 0
72cfad7451c64ef59a18e09d16a79046 | 127.9.82.134:41241 | HEALTHY | <none> | 3 | 0
7dd8e38181f24e349fb179d2a9eb74c1 | 127.9.82.133:33233 | HEALTHY | <none> | 4 | 0
8096a2fe270b492baa3178ad9d2976e7 | 127.9.82.130:43991 | HEALTHY | <none> | 2 | 0
8824a7df8ec9431db37c0bb434ede060 | 127.9.82.135:44285 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 7
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 7 server(s) checked
local_ip_for_outbound_sockets | 127.9.82.129 | experimental | 127.9.82.129:36161
local_ip_for_outbound_sockets | 127.9.82.130 | experimental | 127.9.82.130:43991
local_ip_for_outbound_sockets | 127.9.82.131 | experimental | 127.9.82.131:42315
local_ip_for_outbound_sockets | 127.9.82.132 | experimental | 127.9.82.132:35493
local_ip_for_outbound_sockets | 127.9.82.133 | experimental | 127.9.82.133:33233
local_ip_for_outbound_sockets | 127.9.82.134 | experimental | 127.9.82.134:41241
local_ip_for_outbound_sockets | 127.9.82.135 | experimental | 127.9.82.135:44285
never_fsync | true | unsafe,advanced | all 7 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 7 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 7 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 7 server(s) checked
server_dump_info_format | pb | hidden | all 7 server(s) checked
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.9.82.129:36161
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.9.82.130:43991
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.9.82.131:42315
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.9.82.132:35493
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.9.82.133:33233
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.9.82.134:41241
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.9.82.135:44285
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+--------------------+-------------------------
builtin_ntp_servers | 127.9.82.148:40229 | all 7 server(s) checked
time_source | builtin | all 7 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 8 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 5 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 11
First Quartile | 11
Median | 11
Third Quartile | 12
Maximum | 12
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 7
Tables | 6
Tablets | 16
Replicas | 80
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20240502 20:46:03.273355 9546 log_verifier.cc:126] Checking tablet 011b3f9ecb524a54a242425725b72706
I20240502 20:46:03.382555 9546 log_verifier.cc:177] Verified matching terms for 192 ops in tablet 011b3f9ecb524a54a242425725b72706
I20240502 20:46:03.382745 9546 log_verifier.cc:126] Checking tablet 067f71582a514a66a0b3fc4681a84471
I20240502 20:46:03.511708 9546 log_verifier.cc:177] Verified matching terms for 256 ops in tablet 067f71582a514a66a0b3fc4681a84471
I20240502 20:46:03.512054 9546 log_verifier.cc:126] Checking tablet 1d55d69fcfb44cb29751908f32fb393f
I20240502 20:46:03.684082 9546 log_verifier.cc:177] Verified matching terms for 325 ops in tablet 1d55d69fcfb44cb29751908f32fb393f
I20240502 20:46:03.684343 9546 log_verifier.cc:126] Checking tablet 2bbffeb3e45e4ab78112632675d55ac6
I20240502 20:46:03.816066 9546 log_verifier.cc:177] Verified matching terms for 271 ops in tablet 2bbffeb3e45e4ab78112632675d55ac6
I20240502 20:46:03.816323 9546 log_verifier.cc:126] Checking tablet 319f281517f54ed6998fd74a849b07eb
I20240502 20:46:03.916684 9546 log_verifier.cc:177] Verified matching terms for 171 ops in tablet 319f281517f54ed6998fd74a849b07eb
I20240502 20:46:03.916849 9546 log_verifier.cc:126] Checking tablet 7261de9012914524a7c43551687fdc0b
I20240502 20:46:04.064399 9546 log_verifier.cc:177] Verified matching terms for 287 ops in tablet 7261de9012914524a7c43551687fdc0b
I20240502 20:46:04.064610 9546 log_verifier.cc:126] Checking tablet 81c3873a4eab471da0c19e8bf0eaf03d
I20240502 20:46:04.168192 9546 log_verifier.cc:177] Verified matching terms for 167 ops in tablet 81c3873a4eab471da0c19e8bf0eaf03d
I20240502 20:46:04.168376 9546 log_verifier.cc:126] Checking tablet 897d8b67ce50427885a7ff494d509b13
I20240502 20:46:04.316443 9546 log_verifier.cc:177] Verified matching terms for 297 ops in tablet 897d8b67ce50427885a7ff494d509b13
I20240502 20:46:04.316658 9546 log_verifier.cc:126] Checking tablet 8a2169943b994152ba495bdb810754a0
I20240502 20:46:04.458308 9546 log_verifier.cc:177] Verified matching terms for 286 ops in tablet 8a2169943b994152ba495bdb810754a0
I20240502 20:46:04.458575 9546 log_verifier.cc:126] Checking tablet 959ee5415c0a44bbaf7bb3a1ba870902
I20240502 20:46:04.505193 9546 log_verifier.cc:177] Verified matching terms for 4 ops in tablet 959ee5415c0a44bbaf7bb3a1ba870902
I20240502 20:46:04.505276 9546 log_verifier.cc:126] Checking tablet 95c74a872c72447cbf6c77beecf8bf1c
I20240502 20:46:04.679360 9546 log_verifier.cc:177] Verified matching terms for 326 ops in tablet 95c74a872c72447cbf6c77beecf8bf1c
I20240502 20:46:04.679596 9546 log_verifier.cc:126] Checking tablet c3a361785bd34a5092f09a53c14ccddd
I20240502 20:46:04.841383 9546 log_verifier.cc:177] Verified matching terms for 322 ops in tablet c3a361785bd34a5092f09a53c14ccddd
I20240502 20:46:04.841600 9546 log_verifier.cc:126] Checking tablet cb2ea660d9044aa7a565ab0c19601244
I20240502 20:46:04.953912 9546 log_verifier.cc:177] Verified matching terms for 185 ops in tablet cb2ea660d9044aa7a565ab0c19601244
I20240502 20:46:04.954063 9546 log_verifier.cc:126] Checking tablet d2a72d81232b487ea716903ddb2e0296
I20240502 20:46:05.107067 9546 log_verifier.cc:177] Verified matching terms for 177 ops in tablet d2a72d81232b487ea716903ddb2e0296
I20240502 20:46:05.107230 9546 log_verifier.cc:126] Checking tablet ed4d27cc41454a108252941a99cd16e2
I20240502 20:46:05.277382 9546 log_verifier.cc:177] Verified matching terms for 205 ops in tablet ed4d27cc41454a108252941a99cd16e2
I20240502 20:46:05.277545 9546 log_verifier.cc:126] Checking tablet f3be8e3350854d95922df01b9218a1d7
I20240502 20:46:05.427678 9546 log_verifier.cc:177] Verified matching terms for 261 ops in tablet f3be8e3350854d95922df01b9218a1d7
I20240502 20:46:05.430197 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.136:0
--local_ip_for_outbound_sockets=127.9.82.136
--webserver_interface=127.9.82.136
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--builtin_ntp_servers=127.9.82.148:40229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:46:05.553174 14414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:05.553422 14414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:05.553500 14414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:05.556758 14414 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:05.556844 14414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:05.556957 14414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.136
I20240502 20:46:05.561146 14414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.136:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.9.82.136
--webserver_port=0
--tserver_master_addrs=127.9.82.190:43461
--never_fsync=true
--heap_profile_path=/tmp/kudu.14414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.136
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:05.562225 14414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:05.563670 14414 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:05.573326 14419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:05.573843 14422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:05.574753 14420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:05.575567 14414 server_base.cc:1034] running on GCE node
I20240502 20:46:05.576082 14414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:05.576716 14414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:05.577906 14414 hybrid_clock.cc:648] HybridClock initialized: now 1714682765577839 us; error 84 us; skew 500 ppm
I20240502 20:46:05.580955 14414 webserver.cc:460] Webserver started at http://127.9.82.136:36197/ using document root <none> and password file <none>
I20240502 20:46:05.581650 14414 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:05.581717 14414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:05.581931 14414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:05.583757 14414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "d8d4bb7b6d914451a1843b6555e30d2b"
format_stamp: "Formatted at 2024-05-02 20:46:05 on dist-test-slave-2pss"
I20240502 20:46:05.584302 14414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "d8d4bb7b6d914451a1843b6555e30d2b"
format_stamp: "Formatted at 2024-05-02 20:46:05 on dist-test-slave-2pss"
I20240502 20:46:05.588341 14414 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20240502 20:46:05.591454 14429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:05.592743 14414 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:46:05.592916 14414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "d8d4bb7b6d914451a1843b6555e30d2b"
format_stamp: "Formatted at 2024-05-02 20:46:05 on dist-test-slave-2pss"
I20240502 20:46:05.593091 14414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:05.624235 14414 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:05.625031 14414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:05.625207 14414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:05.625799 14414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:05.626771 14414 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:05.626830 14414 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:05.626880 14414 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:05.626915 14414 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:05.644222 14414 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.136:42479
I20240502 20:46:05.644388 14543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.136:42479 every 8 connection(s)
I20240502 20:46:05.645349 14414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 20:46:05.650442 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 14414
I20240502 20:46:05.650601 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20240502 20:46:05.661183 14544 heartbeater.cc:347] Connected to a master server at 127.9.82.190:43461
I20240502 20:46:05.661520 14544 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:05.662416 14544 heartbeater.cc:511] Master 127.9.82.190:43461 requested a full tablet report, sending...
I20240502 20:46:05.663712 11425 ts_manager.cc:194] Registered new tserver with Master: d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479)
I20240502 20:46:05.664443 11425 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.136:45725
I20240502 20:46:05.877894 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:46:05.878234 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:05.883750 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:05.886107 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:05.893877 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:05.898118 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:05.915944 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:05.916551 14478 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:06.026588 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:06.027083 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:06.029796 14478 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:06.030221 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:46:06.034775 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:06.045495 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:06.051249 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:06.056814 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:06.103952 11828 consensus_queue.cc:237] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 261, Committed index: 261, Last appended: 1.261, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 262 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.106273 11699 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 261. Preceding OpId from leader: term: 1 index: 262. (index mismatch)
I20240502 20:46:06.106273 11563 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 261. Preceding OpId from leader: term: 1 index: 262. (index mismatch)
I20240502 20:46:06.106330 12091 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 261. Preceding OpId from leader: term: 1 index: 262. (index mismatch)
I20240502 20:46:06.106791 14640 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 262, Last known committed idx: 261, Time since last communication: 0.000s
I20240502 20:46:06.107000 14641 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 262, Last known committed idx: 261, Time since last communication: 0.000s
I20240502 20:46:06.107270 11958 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 261. Preceding OpId from leader: term: 1 index: 262. (index mismatch)
I20240502 20:46:06.108446 14641 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 262, Last known committed idx: 261, Time since last communication: 0.001s
I20240502 20:46:06.108656 14640 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 262, Last known committed idx: 261, Time since last communication: 0.000s
I20240502 20:46:06.109815 14642 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.262: config changed from index -1 to 262, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 262 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.111238 11958 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.262: config changed from index -1 to 262, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 262 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.112859 12091 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.262: config changed from index -1 to 262, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 262 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
W20240502 20:46:06.113356 11767 consensus_peers.cc:485] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3be8e3350854d95922df01b9218a1d7. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:06.114701 11419 catalog_manager.cc:5484] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index -1 to 262, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 262 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:06.115016 11699 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.262: config changed from index -1 to 262, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 262 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.116883 11563 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.262: config changed from index -1 to 262, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 262 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.125831 11828 consensus_queue.cc:237] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 177, Committed index: 177, Last appended: 1.177, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 178 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.127981 12221 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 177. Preceding OpId from leader: term: 1 index: 178. (index mismatch)
W20240502 20:46:06.128113 11767 consensus_peers.cc:485] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2a72d81232b487ea716903ddb2e0296. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:06.128255 12091 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 177. Preceding OpId from leader: term: 1 index: 178. (index mismatch)
I20240502 20:46:06.128422 11699 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 177. Preceding OpId from leader: term: 1 index: 178. (index mismatch)
I20240502 20:46:06.128615 11563 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 177. Preceding OpId from leader: term: 1 index: 178. (index mismatch)
I20240502 20:46:06.128614 14357 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 178, Last known committed idx: 177, Time since last communication: 0.000s
I20240502 20:46:06.128829 14434 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 178, Last known committed idx: 177, Time since last communication: 0.000s
I20240502 20:46:06.129031 14640 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 178, Last known committed idx: 177, Time since last communication: 0.000s
I20240502 20:46:06.129205 14642 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 178, Last known committed idx: 177, Time since last communication: 0.000s
I20240502 20:46:06.132076 14641 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.178: config changed from index -1 to 178, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 178 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.133409 11563 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.178: config changed from index -1 to 178, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 178 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.133697 11699 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.178: config changed from index -1 to 178, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 178 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.135622 12221 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.178: config changed from index -1 to 178, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 178 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.135696 11417 catalog_manager.cc:5484] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index -1 to 178, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 178 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:06.137681 12091 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.178: config changed from index -1 to 178, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 178 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.147416 11699 consensus_queue.cc:237] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 297, Committed index: 297, Last appended: 1.297, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 298 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.149652 12091 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 297. Preceding OpId from leader: term: 1 index: 298. (index mismatch)
I20240502 20:46:06.149652 11828 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 297. Preceding OpId from leader: term: 1 index: 298. (index mismatch)
I20240502 20:46:06.150097 12221 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 297. Preceding OpId from leader: term: 1 index: 298. (index mismatch)
I20240502 20:46:06.150259 13161 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 297. Preceding OpId from leader: term: 1 index: 298. (index mismatch)
I20240502 20:46:06.150318 14364 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 298, Last known committed idx: 297, Time since last communication: 0.000s
I20240502 20:46:06.150655 14364 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 298, Last known committed idx: 297, Time since last communication: 0.000s
I20240502 20:46:06.150815 14671 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 298, Last known committed idx: 297, Time since last communication: 0.000s
I20240502 20:46:06.151099 14672 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 298, Last known committed idx: 297, Time since last communication: 0.000s
I20240502 20:46:06.154101 14364 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.298: config changed from index 137 to 298, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 298 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.154436 13161 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.298: config changed from index 137 to 298, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 298 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
W20240502 20:46:06.154736 11636 consensus_peers.cc:485] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 897d8b67ce50427885a7ff494d509b13. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:06.154989 12221 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.298: config changed from index 137 to 298, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 298 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.157065 11419 catalog_manager.cc:5484] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index 137 to 298, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 298 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:06.157591 12091 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.298: config changed from index 137 to 298, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 298 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.158260 11828 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.298: config changed from index 137 to 298, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 298 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.169035 11958 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 286, Committed index: 286, Last appended: 1.286, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 287 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.171772 12221 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 286. Preceding OpId from leader: term: 1 index: 287. (index mismatch)
I20240502 20:46:06.171875 13161 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 286. Preceding OpId from leader: term: 1 index: 287. (index mismatch)
I20240502 20:46:06.172006 11699 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 286. Preceding OpId from leader: term: 1 index: 287. (index mismatch)
I20240502 20:46:06.172425 14685 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 287, Last known committed idx: 286, Time since last communication: 0.000s
I20240502 20:46:06.172639 14410 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 287, Last known committed idx: 286, Time since last communication: 0.000s
I20240502 20:46:06.172783 14686 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 287, Last known committed idx: 286, Time since last communication: 0.000s
I20240502 20:46:06.175359 11563 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 286. Preceding OpId from leader: term: 1 index: 287. (index mismatch)
I20240502 20:46:06.175304 14687 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.287: config changed from index 194 to 287, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 287 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
W20240502 20:46:06.176088 11898 consensus_peers.cc:485] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a2169943b994152ba495bdb810754a0. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:06.176272 14685 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 287, Last known committed idx: 286, Time since last communication: 0.000s
I20240502 20:46:06.176157 11699 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.287: config changed from index 194 to 287, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 287 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.178717 11423 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index 194 to 287, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 287 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.179522 12221 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.287: config changed from index 194 to 287, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 287 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.181360 11563 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.287: config changed from index 194 to 287, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 287 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.185164 13161 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.287: config changed from index 194 to 287, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 287 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.192796 12091 consensus_queue.cc:237] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.195369 11828 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:06.195380 12221 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:06.195794 14412 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:06.196156 14549 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:06.196481 11958 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:06.196568 13161 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:06.197186 14549 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:06.197657 14412 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:06.199154 14549 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.202167 12221 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.202600 11828 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.204339 11421 catalog_manager.cc:5484] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 4 to 5, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:06.204809 13161 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:06.205332 11958 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
W20240502 20:46:06.207275 12029 consensus_peers.cc:485] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 959ee5415c0a44bbaf7bb3a1ba870902. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:06.496342 14758 ts_tablet_manager.cc:902] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:46:06.497092 14758 tablet_copy_client.cc:308] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:42315
I20240502 20:46:06.501077 11852 tablet_copy_service.cc:140] P 07fe14e7347a4682bd8f6026ad776da3: Received BeginTabletCopySession request for tablet f3be8e3350854d95922df01b9218a1d7 from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:40341)
I20240502 20:46:06.501220 11852 tablet_copy_service.cc:161] P 07fe14e7347a4682bd8f6026ad776da3: Beginning new tablet copy session on tablet f3be8e3350854d95922df01b9218a1d7 from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:40341: session id = d8d4bb7b6d914451a1843b6555e30d2b-f3be8e3350854d95922df01b9218a1d7
I20240502 20:46:06.502200 11852 tablet_copy_source_session.cc:205] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:06.505475 14758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3be8e3350854d95922df01b9218a1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:06.510730 14758 tablet_copy_client.cc:783] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:06.510946 14758 tablet_copy_client.cc:647] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:06.513859 14758 tablet_copy_client.cc:523] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:06.515859 14758 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:06.540922 14758 log.cc:824] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:06.548849 14765 ts_tablet_manager.cc:902] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991)
I20240502 20:46:06.549469 14765 tablet_copy_client.cc:308] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:43991
I20240502 20:46:06.553726 11721 tablet_copy_service.cc:140] P 8096a2fe270b492baa3178ad9d2976e7: Received BeginTabletCopySession request for tablet 897d8b67ce50427885a7ff494d509b13 from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:58449)
I20240502 20:46:06.553843 11721 tablet_copy_service.cc:161] P 8096a2fe270b492baa3178ad9d2976e7: Beginning new tablet copy session on tablet 897d8b67ce50427885a7ff494d509b13 from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:58449: session id = d8d4bb7b6d914451a1843b6555e30d2b-897d8b67ce50427885a7ff494d509b13
I20240502 20:46:06.554647 11721 tablet_copy_source_session.cc:205] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:06.555581 14765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 897d8b67ce50427885a7ff494d509b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:06.557586 14765 tablet_copy_client.cc:783] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:06.557766 14765 tablet_copy_client.cc:647] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:06.560169 14765 tablet_copy_client.cc:523] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:06.561342 14765 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:06.568881 14770 ts_tablet_manager.cc:902] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:46:06.569626 14770 tablet_copy_client.cc:308] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:42315
I20240502 20:46:06.570109 11852 tablet_copy_service.cc:140] P 07fe14e7347a4682bd8f6026ad776da3: Received BeginTabletCopySession request for tablet d2a72d81232b487ea716903ddb2e0296 from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:40341)
I20240502 20:46:06.570240 11852 tablet_copy_service.cc:161] P 07fe14e7347a4682bd8f6026ad776da3: Beginning new tablet copy session on tablet d2a72d81232b487ea716903ddb2e0296 from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:40341: session id = d8d4bb7b6d914451a1843b6555e30d2b-d2a72d81232b487ea716903ddb2e0296
I20240502 20:46:06.571352 11852 tablet_copy_source_session.cc:205] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:06.572499 14770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2a72d81232b487ea716903ddb2e0296. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:06.575135 14770 tablet_copy_client.cc:783] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:06.575314 14770 tablet_copy_client.cc:647] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:06.577111 14770 tablet_copy_client.cc:523] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:06.578437 14770 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:06.641929 14777 ts_tablet_manager.cc:902] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493)
I20240502 20:46:06.642571 14777 tablet_copy_client.cc:308] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:35493
I20240502 20:46:06.650102 11983 tablet_copy_service.cc:140] P 6529b03451c9475ab62c51f71714b0cf: Received BeginTabletCopySession request for tablet 8a2169943b994152ba495bdb810754a0 from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:51483)
I20240502 20:46:06.650256 11983 tablet_copy_service.cc:161] P 6529b03451c9475ab62c51f71714b0cf: Beginning new tablet copy session on tablet 8a2169943b994152ba495bdb810754a0 from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:51483: session id = d8d4bb7b6d914451a1843b6555e30d2b-8a2169943b994152ba495bdb810754a0
I20240502 20:46:06.651335 11983 tablet_copy_source_session.cc:205] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:06.652665 14777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a2169943b994152ba495bdb810754a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:06.656219 14777 tablet_copy_client.cc:783] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:06.656525 14777 tablet_copy_client.cc:647] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:06.659000 14777 tablet_copy_client.cc:523] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:06.660542 14777 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:06.667577 14544 heartbeater.cc:503] Master 127.9.82.190:43461 was elected leader, sending a full tablet report...
I20240502 20:46:06.709945 14792 ts_tablet_manager.cc:902] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:46:06.711611 14792 tablet_copy_client.cc:308] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:33233
I20240502 20:46:06.716377 12114 tablet_copy_service.cc:140] P 7dd8e38181f24e349fb179d2a9eb74c1: Received BeginTabletCopySession request for tablet 959ee5415c0a44bbaf7bb3a1ba870902 from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:59177)
I20240502 20:46:06.716508 12114 tablet_copy_service.cc:161] P 7dd8e38181f24e349fb179d2a9eb74c1: Beginning new tablet copy session on tablet 959ee5415c0a44bbaf7bb3a1ba870902 from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:59177: session id = d8d4bb7b6d914451a1843b6555e30d2b-959ee5415c0a44bbaf7bb3a1ba870902
I20240502 20:46:06.717214 12114 tablet_copy_source_session.cc:205] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:06.718068 14792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 959ee5415c0a44bbaf7bb3a1ba870902. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:06.720925 14792 tablet_copy_client.cc:783] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:06.721143 14792 tablet_copy_client.cc:647] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:06.722273 14792 tablet_copy_client.cc:523] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:06.723538 14792 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:06.728993 14792 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:06.729362 14792 tablet_bootstrap.cc:492] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:06.729684 14792 ts_tablet_manager.cc:1367] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20240502 20:46:06.733448 14792 raft_consensus.cc:348] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.733875 14792 raft_consensus.cc:729] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:06.734328 14792 consensus_queue.cc:260] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.735504 14792 ts_tablet_manager.cc:1398] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240502 20:46:06.737597 12114 tablet_copy_service.cc:342] P 7dd8e38181f24e349fb179d2a9eb74c1: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-959ee5415c0a44bbaf7bb3a1ba870902 received from {username='slave'} at 127.9.82.136:59177
I20240502 20:46:06.737700 12114 tablet_copy_service.cc:433] P 7dd8e38181f24e349fb179d2a9eb74c1: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-959ee5415c0a44bbaf7bb3a1ba870902 on tablet 959ee5415c0a44bbaf7bb3a1ba870902 with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:06.753177 14758 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=262 overwritten=0 applied=262 ignored=0} inserts{seen=934 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:06.753659 14758 tablet_bootstrap.cc:492] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:06.753926 14758 ts_tablet_manager.cc:1367] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.238s user 0.195s sys 0.012s
I20240502 20:46:06.754616 14758 raft_consensus.cc:348] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 262 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.754945 14758 raft_consensus.cc:729] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:06.755105 14758 consensus_queue.cc:260] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 262, Last appended: 1.262, Last appended by leader: 262, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 262 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.755553 14758 ts_tablet_manager.cc:1398] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:06.756168 11852 tablet_copy_service.cc:342] P 07fe14e7347a4682bd8f6026ad776da3: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-f3be8e3350854d95922df01b9218a1d7 received from {username='slave'} at 127.9.82.136:40341
I20240502 20:46:06.756268 11852 tablet_copy_service.cc:433] P 07fe14e7347a4682bd8f6026ad776da3: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-f3be8e3350854d95922df01b9218a1d7 on tablet f3be8e3350854d95922df01b9218a1d7 with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:06.758523 14770 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=178 overwritten=0 applied=178 ignored=0} inserts{seen=809 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:06.758858 14770 tablet_bootstrap.cc:492] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:06.759071 14770 ts_tablet_manager.cc:1367] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.181s user 0.139s sys 0.004s
I20240502 20:46:06.759524 14770 raft_consensus.cc:348] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 178 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.759653 14770 raft_consensus.cc:729] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:06.760257 14770 consensus_queue.cc:260] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 178, Last appended: 1.178, Last appended by leader: 178, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 178 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.760579 14770 ts_tablet_manager.cc:1398] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:46:06.761072 11852 tablet_copy_service.cc:342] P 07fe14e7347a4682bd8f6026ad776da3: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-d2a72d81232b487ea716903ddb2e0296 received from {username='slave'} at 127.9.82.136:40341
I20240502 20:46:06.761155 11852 tablet_copy_service.cc:433] P 07fe14e7347a4682bd8f6026ad776da3: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-d2a72d81232b487ea716903ddb2e0296 on tablet d2a72d81232b487ea716903ddb2e0296 with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:06.819036 14765 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=298 overwritten=0 applied=298 ignored=0} inserts{seen=926 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:06.819363 14765 tablet_bootstrap.cc:492] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:06.819578 14765 ts_tablet_manager.cc:1367] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.258s user 0.198s sys 0.020s
I20240502 20:46:06.820053 14765 raft_consensus.cc:348] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 298 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.820174 14765 raft_consensus.cc:729] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:06.820276 14765 consensus_queue.cc:260] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 298, Last appended: 1.298, Last appended by leader: 298, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 298 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.820533 14765 ts_tablet_manager.cc:1398] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:46:06.821476 11721 tablet_copy_service.cc:342] P 8096a2fe270b492baa3178ad9d2976e7: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-897d8b67ce50427885a7ff494d509b13 received from {username='slave'} at 127.9.82.136:58449
I20240502 20:46:06.821576 11721 tablet_copy_service.cc:433] P 8096a2fe270b492baa3178ad9d2976e7: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-897d8b67ce50427885a7ff494d509b13 on tablet 897d8b67ce50427885a7ff494d509b13 with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:06.923209 14777 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=287 overwritten=0 applied=287 ignored=0} inserts{seen=966 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:06.923501 14777 tablet_bootstrap.cc:492] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:06.923741 14777 ts_tablet_manager.cc:1367] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.263s user 0.182s sys 0.012s
I20240502 20:46:06.924192 14777 raft_consensus.cc:348] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 287 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.924315 14777 raft_consensus.cc:729] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:06.924393 14777 consensus_queue.cc:260] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 287, Last appended: 1.287, Last appended by leader: 287, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 287 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:06.924655 14777 ts_tablet_manager.cc:1398] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:06.925294 11983 tablet_copy_service.cc:342] P 6529b03451c9475ab62c51f71714b0cf: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-8a2169943b994152ba495bdb810754a0 received from {username='slave'} at 127.9.82.136:51483
I20240502 20:46:06.925396 11983 tablet_copy_service.cc:433] P 6529b03451c9475ab62c51f71714b0cf: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-8a2169943b994152ba495bdb810754a0 on tablet 8a2169943b994152ba495bdb810754a0 with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:07.052042 14498 raft_consensus.cc:1203] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.297->[1.298-1.298] Dedup: 1.298->[]
I20240502 20:46:07.092314 14498 raft_consensus.cc:1203] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.286->[1.287-1.287] Dedup: 1.287->[]
I20240502 20:46:07.105249 14498 raft_consensus.cc:1203] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.261->[1.262-1.262] Dedup: 1.262->[]
I20240502 20:46:07.121862 14498 raft_consensus.cc:1203] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.177->[1.178-1.178] Dedup: 1.178->[]
I20240502 20:46:07.148996 14498 raft_consensus.cc:1203] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:46:07.535069 14843 raft_consensus.cc:1050] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:07.535532 14843 consensus_queue.cc:237] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 262, Committed index: 262, Last appended: 1.262, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 263 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.537300 14498 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 262. Preceding OpId from leader: term: 1 index: 263. (index mismatch)
I20240502 20:46:07.537449 11563 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 262. Preceding OpId from leader: term: 1 index: 263. (index mismatch)
I20240502 20:46:07.537449 11958 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 262. Preceding OpId from leader: term: 1 index: 263. (index mismatch)
I20240502 20:46:07.537871 11699 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 262. Preceding OpId from leader: term: 1 index: 263. (index mismatch)
I20240502 20:46:07.537993 12090 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 262. Preceding OpId from leader: term: 1 index: 263. (index mismatch)
I20240502 20:46:07.538548 14897 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 263, Last known committed idx: 262, Time since last communication: 0.000s
I20240502 20:46:07.538861 14815 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 263, Last known committed idx: 262, Time since last communication: 0.000s
I20240502 20:46:07.539029 14898 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 263, Last known committed idx: 262, Time since last communication: 0.000s
I20240502 20:46:07.539227 14896 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 263, Last known committed idx: 262, Time since last communication: 0.000s
I20240502 20:46:07.539623 14843 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 263, Last known committed idx: 262, Time since last communication: 0.000s
I20240502 20:46:07.543606 14898 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.263: config changed from index 262 to 263, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 263 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.544183 11699 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.263: config changed from index 262 to 263, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 263 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.544035 14498 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.263: config changed from index 262 to 263, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 263 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.545656 11563 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.263: config changed from index 262 to 263, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 263 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.547214 11417 catalog_manager.cc:5484] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 262 to 263, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 263 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:07.548998 11958 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.263: config changed from index 262 to 263, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 263 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.549110 12090 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.263: config changed from index 262 to 263, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 263 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.554543 11828 consensus_queue.cc:237] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 263, Committed index: 263, Last appended: 1.263, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 264 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.556411 12090 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 263. Preceding OpId from leader: term: 1 index: 264. (index mismatch)
I20240502 20:46:07.556605 11699 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 263. Preceding OpId from leader: term: 1 index: 264. (index mismatch)
I20240502 20:46:07.556607 11563 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 263. Preceding OpId from leader: term: 1 index: 264. (index mismatch)
I20240502 20:46:07.556741 14498 raft_consensus.cc:1261] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 263. Preceding OpId from leader: term: 1 index: 264. (index mismatch)
I20240502 20:46:07.556958 14896 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 264, Last known committed idx: 263, Time since last communication: 0.000s
I20240502 20:46:07.557158 14898 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 264, Last known committed idx: 263, Time since last communication: 0.000s
I20240502 20:46:07.557389 14897 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 264, Last known committed idx: 263, Time since last communication: 0.000s
I20240502 20:46:07.557519 14898 consensus_queue.cc:1035] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 264, Last known committed idx: 263, Time since last communication: 0.000s
I20240502 20:46:07.560583 14844 raft_consensus.cc:1050] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:07.561179 14844 consensus_queue.cc:237] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.561719 14896 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.264: config changed from index 263 to 264, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 264 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.562367 11699 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.264: config changed from index 263 to 264, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 264 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.562723 12090 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.264: config changed from index 263 to 264, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 264 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.563424 12221 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:07.563879 14707 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:07.564419 11563 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.264: config changed from index 263 to 264, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 264 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.565093 13161 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:07.565573 14912 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:07.566027 11411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f3be8e3350854d95922df01b9218a1d7 with cas_config_opid_index 263: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:07.566805 11958 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:07.567370 14412 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:07.567623 14497 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:07.567979 14498 raft_consensus.cc:2932] T f3be8e3350854d95922df01b9218a1d7 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.264: config changed from index 263 to 264, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 264 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.568540 11422 catalog_manager.cc:5484] T f3be8e3350854d95922df01b9218a1d7 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 263 to 264, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 264 OBSOLETE_local: false peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:07.569540 14412 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:07.573921 14843 raft_consensus.cc:1050] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:07.574517 14843 consensus_queue.cc:237] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 178, Committed index: 178, Last appended: 1.178, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 179 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.575369 11941 tablet_service.cc:1514] Processing DeleteTablet for tablet f3be8e3350854d95922df01b9218a1d7 with delete_type TABLET_DATA_TOMBSTONED (TS 6529b03451c9475ab62c51f71714b0cf not found in new config with opid_index 264) from {username='slave'} at 127.0.0.1:39680
I20240502 20:46:07.576841 12090 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 178. Preceding OpId from leader: term: 1 index: 179. (index mismatch)
I20240502 20:46:07.576983 11563 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 178. Preceding OpId from leader: term: 1 index: 179. (index mismatch)
I20240502 20:46:07.577389 11699 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 178. Preceding OpId from leader: term: 1 index: 179. (index mismatch)
I20240502 20:46:07.577819 12221 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 178. Preceding OpId from leader: term: 1 index: 179. (index mismatch)
I20240502 20:46:07.578182 11828 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:07.578569 14496 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 178. Preceding OpId from leader: term: 1 index: 179. (index mismatch)
I20240502 20:46:07.578619 14412 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:07.578869 14897 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 179, Last known committed idx: 178, Time since last communication: 0.000s
I20240502 20:46:07.579952 14910 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.580457 11958 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.580646 14640 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 179, Last known committed idx: 178, Time since last communication: 0.000s
I20240502 20:46:07.581015 14640 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 179, Last known committed idx: 178, Time since last communication: 0.000s
I20240502 20:46:07.581265 14640 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 179, Last known committed idx: 178, Time since last communication: 0.000s
I20240502 20:46:07.582581 13161 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.583158 11419 catalog_manager.cc:5484] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 5 to 6, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:07.585217 12224 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.586004 11828 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.586660 14918 tablet_replica.cc:330] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf: stopping tablet replica
I20240502 20:46:07.586805 14918 raft_consensus.cc:2229] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:07.588009 14918 raft_consensus.cc:2258] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:07.587965 14898 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 179, Last known committed idx: 178, Time since last communication: 0.000s
I20240502 20:46:07.589663 14496 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.590211 14918 ts_tablet_manager.cc:1875] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:07.592330 12090 consensus_queue.cc:237] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.592921 14918 ts_tablet_manager.cc:1888] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.263
I20240502 20:46:07.592998 14918 log.cc:1196] T f3be8e3350854d95922df01b9218a1d7 P 6529b03451c9475ab62c51f71714b0cf: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/f3be8e3350854d95922df01b9218a1d7
I20240502 20:46:07.593618 11413 catalog_manager.cc:4830] TS 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493): tablet f3be8e3350854d95922df01b9218a1d7 (table rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]) successfully deleted
I20240502 20:46:07.594035 12221 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:07.594305 11958 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:07.594538 14912 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:07.594727 14911 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:07.594772 13160 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:07.596648 14412 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:07.596803 14842 raft_consensus.cc:1050] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:07.597288 14842 consensus_queue.cc:237] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 298, Committed index: 298, Last appended: 1.298, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 299 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.598824 14498 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 298. Preceding OpId from leader: term: 1 index: 299. (index mismatch)
I20240502 20:46:07.598956 14910 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.599247 14841 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 299, Last known committed idx: 298, Time since last communication: 0.000s
I20240502 20:46:07.600322 14496 raft_consensus.cc:1261] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:07.600951 14897 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.179: config changed from index 178 to 179, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 179 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.601792 11828 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 298. Preceding OpId from leader: term: 1 index: 299. (index mismatch)
I20240502 20:46:07.601835 13161 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.602131 12221 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 298. Preceding OpId from leader: term: 1 index: 299. (index mismatch)
I20240502 20:46:07.602748 13160 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 298. Preceding OpId from leader: term: 1 index: 299. (index mismatch)
I20240502 20:46:07.602789 14842 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 299, Last known committed idx: 298, Time since last communication: 0.000s
I20240502 20:46:07.603130 12090 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 298. Preceding OpId from leader: term: 1 index: 299. (index mismatch)
I20240502 20:46:07.603065 12091 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.179: config changed from index 178 to 179, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 179 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.603438 14842 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 299, Last known committed idx: 298, Time since last communication: 0.000s
I20240502 20:46:07.603816 14842 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 299, Last known committed idx: 298, Time since last communication: 0.000s
I20240502 20:46:07.604240 14841 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 299, Last known committed idx: 298, Time since last communication: 0.000s
I20240502 20:46:07.605299 11958 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.605370 12224 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.606941 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 959ee5415c0a44bbaf7bb3a1ba870902 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:07.608315 11425 catalog_manager.cc:5484] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 6 to 7, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:07.608985 11563 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.179: config changed from index 178 to 179, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 179 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.609202 11699 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.179: config changed from index 178 to 179, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 179 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.610519 14412 consensus_queue.cc:1035] T 959ee5415c0a44bbaf7bb3a1ba870902 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:07.611629 11423 catalog_manager.cc:5484] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 178 to 179, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 179 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:07.612627 14498 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.179: config changed from index 178 to 179, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 179 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.613538 14496 raft_consensus.cc:2932] T 959ee5415c0a44bbaf7bb3a1ba870902 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.614344 12224 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.179: config changed from index 178 to 179, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 179 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.616515 11810 tablet_service.cc:1514] Processing DeleteTablet for tablet 959ee5415c0a44bbaf7bb3a1ba870902 with delete_type TABLET_DATA_TOMBSTONED (TS 07fe14e7347a4682bd8f6026ad776da3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:39248
I20240502 20:46:07.619552 14936 tablet_replica.cc:330] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: stopping tablet replica
I20240502 20:46:07.620306 14936 raft_consensus.cc:2229] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:07.620672 14936 raft_consensus.cc:2258] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:07.621383 14841 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.299: config changed from index 298 to 299, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 299 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.621878 13161 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.299: config changed from index 298 to 299, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 299 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.622057 12221 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.299: config changed from index 298 to 299, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 299 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.624336 11832 consensus_queue.cc:237] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 179, Committed index: 179, Last appended: 1.179, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 180 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.624462 12091 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.299: config changed from index 298 to 299, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 299 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.625222 11418 catalog_manager.cc:5484] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index 298 to 299, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 299 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:07.626971 12091 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 179. Preceding OpId from leader: term: 1 index: 180. (index mismatch)
I20240502 20:46:07.626971 11563 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 179. Preceding OpId from leader: term: 1 index: 180. (index mismatch)
I20240502 20:46:07.627434 14496 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 179. Preceding OpId from leader: term: 1 index: 180. (index mismatch)
I20240502 20:46:07.627457 14843 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 180, Last known committed idx: 179, Time since last communication: 0.000s
I20240502 20:46:07.627869 14898 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 180, Last known committed idx: 179, Time since last communication: 0.000s
I20240502 20:46:07.628041 14815 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 180, Last known committed idx: 179, Time since last communication: 0.000s
I20240502 20:46:07.628101 11828 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.299: config changed from index 298 to 299, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 299 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.628582 12221 raft_consensus.cc:1261] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 179. Preceding OpId from leader: term: 1 index: 180. (index mismatch)
I20240502 20:46:07.629031 14898 consensus_queue.cc:1035] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 180, Last known committed idx: 179, Time since last communication: 0.000s
I20240502 20:46:07.630220 14498 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.299: config changed from index 298 to 299, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 299 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.632066 14936 ts_tablet_manager.cc:1875] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:07.632745 14898 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.180: config changed from index 179 to 180, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 180 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.633127 11563 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.180: config changed from index 179 to 180, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 180 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.634940 11411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d2a72d81232b487ea716903ddb2e0296 with cas_config_opid_index 179: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:07.635371 12221 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.180: config changed from index 179 to 180, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 180 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.636468 11417 catalog_manager.cc:5484] T d2a72d81232b487ea716903ddb2e0296 P 5521e131639043f8b116f9c71cf4bfee reported cstate change: config changed from index 179 to 180, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 180 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.638252 11699 consensus_queue.cc:237] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 299, Committed index: 299, Last appended: 1.299, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 300 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.638603 14936 ts_tablet_manager.cc:1888] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:46:07.638764 14936 log.cc:1196] T 959ee5415c0a44bbaf7bb3a1ba870902 P 07fe14e7347a4682bd8f6026ad776da3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/959ee5415c0a44bbaf7bb3a1ba870902
I20240502 20:46:07.639112 12091 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.180: config changed from index 179 to 180, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 180 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.639972 11411 catalog_manager.cc:4830] TS 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315): tablet 959ee5415c0a44bbaf7bb3a1ba870902 (table TestTable [id=24950fede60f4eeba3f6c0e0914d81ef]) successfully deleted
I20240502 20:46:07.640014 14498 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 299. Preceding OpId from leader: term: 1 index: 300. (index mismatch)
I20240502 20:46:07.640228 12090 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 299. Preceding OpId from leader: term: 1 index: 300. (index mismatch)
I20240502 20:46:07.640601 11828 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 299. Preceding OpId from leader: term: 1 index: 300. (index mismatch)
I20240502 20:46:07.640733 14841 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 300, Last known committed idx: 299, Time since last communication: 0.000s
I20240502 20:46:07.641058 14842 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 300, Last known committed idx: 299, Time since last communication: 0.000s
I20240502 20:46:07.641422 14842 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 300, Last known committed idx: 299, Time since last communication: 0.000s
I20240502 20:46:07.641630 13161 raft_consensus.cc:1261] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 299. Preceding OpId from leader: term: 1 index: 300. (index mismatch)
I20240502 20:46:07.643141 14930 consensus_queue.cc:1035] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 300, Last known committed idx: 299, Time since last communication: 0.000s
I20240502 20:46:07.644131 11680 tablet_service.cc:1514] Processing DeleteTablet for tablet d2a72d81232b487ea716903ddb2e0296 with delete_type TABLET_DATA_TOMBSTONED (TS 8096a2fe270b492baa3178ad9d2976e7 not found in new config with opid_index 180) from {username='slave'} at 127.0.0.1:40458
I20240502 20:46:07.645072 14496 raft_consensus.cc:2932] T d2a72d81232b487ea716903ddb2e0296 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.180: config changed from index 179 to 180, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 180 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.646631 14842 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.300: config changed from index 299 to 300, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 300 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.648821 13161 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.300: config changed from index 299 to 300, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 300 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.649284 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 897d8b67ce50427885a7ff494d509b13 with cas_config_opid_index 299: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:07.650208 12094 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.300: config changed from index 299 to 300, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 300 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.652549 14496 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.300: config changed from index 299 to 300, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 300 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.653045 11421 catalog_manager.cc:5484] T 897d8b67ce50427885a7ff494d509b13 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 299 to 300, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 300 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.654523 11828 raft_consensus.cc:2932] T 897d8b67ce50427885a7ff494d509b13 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 FOLLOWER]: Committing config change with OpId 1.300: config changed from index 299 to 300, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 300 OBSOLETE_local: false peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.655122 14938 tablet_replica.cc:330] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7: stopping tablet replica
I20240502 20:46:07.655275 14938 raft_consensus.cc:2229] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:07.655432 14938 raft_consensus.cc:2258] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:07.657196 14938 ts_tablet_manager.cc:1875] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:07.658948 12205 tablet_service.cc:1514] Processing DeleteTablet for tablet 897d8b67ce50427885a7ff494d509b13 with delete_type TABLET_DATA_TOMBSTONED (TS 72cfad7451c64ef59a18e09d16a79046 not found in new config with opid_index 300) from {username='slave'} at 127.0.0.1:36220
I20240502 20:46:07.659435 14939 tablet_replica.cc:330] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046: stopping tablet replica
I20240502 20:46:07.659646 14939 raft_consensus.cc:2229] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:07.659965 14939 raft_consensus.cc:2258] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:07.660853 14938 ts_tablet_manager.cc:1888] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.179
I20240502 20:46:07.660991 14938 log.cc:1196] T d2a72d81232b487ea716903ddb2e0296 P 8096a2fe270b492baa3178ad9d2976e7: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/d2a72d81232b487ea716903ddb2e0296
I20240502 20:46:07.661645 11413 catalog_manager.cc:4830] TS 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991): tablet d2a72d81232b487ea716903ddb2e0296 (table rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]) successfully deleted
I20240502 20:46:07.661744 14939 ts_tablet_manager.cc:1875] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:07.663662 14939 ts_tablet_manager.cc:1888] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.299
I20240502 20:46:07.663770 14939 log.cc:1196] T 897d8b67ce50427885a7ff494d509b13 P 72cfad7451c64ef59a18e09d16a79046: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/wals/897d8b67ce50427885a7ff494d509b13
I20240502 20:46:07.664424 11411 catalog_manager.cc:4830] TS 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241): tablet 897d8b67ce50427885a7ff494d509b13 (table rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]) successfully deleted
I20240502 20:46:07.676800 14686 raft_consensus.cc:1050] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:07.677457 14686 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 287, Committed index: 287, Last appended: 1.287, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 288 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.679255 11699 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 287. Preceding OpId from leader: term: 1 index: 288. (index mismatch)
I20240502 20:46:07.679458 14496 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 287. Preceding OpId from leader: term: 1 index: 288. (index mismatch)
I20240502 20:46:07.679744 14686 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 288, Last known committed idx: 287, Time since last communication: 0.000s
I20240502 20:46:07.680112 14940 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 288, Last known committed idx: 287, Time since last communication: 0.000s
I20240502 20:46:07.680192 11563 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 287. Preceding OpId from leader: term: 1 index: 288. (index mismatch)
I20240502 20:46:07.680757 13161 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 287. Preceding OpId from leader: term: 1 index: 288. (index mismatch)
I20240502 20:46:07.679672 12221 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 287. Preceding OpId from leader: term: 1 index: 288. (index mismatch)
I20240502 20:46:07.681484 14947 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 288, Last known committed idx: 287, Time since last communication: 0.000s
I20240502 20:46:07.681876 14950 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 288, Last known committed idx: 287, Time since last communication: 0.000s
I20240502 20:46:07.682209 14949 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 288, Last known committed idx: 287, Time since last communication: 0.000s
I20240502 20:46:07.685122 14950 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.288: config changed from index 287 to 288, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 288 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.685520 14496 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.288: config changed from index 287 to 288, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 288 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.686177 13161 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.288: config changed from index 287 to 288, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 288 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.688762 11422 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b reported cstate change: config changed from index 287 to 288, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 288 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.689735 11563 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.288: config changed from index 287 to 288, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 288 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.691524 12221 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.288: config changed from index 287 to 288, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 288 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.693133 11699 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.288: config changed from index 287 to 288, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 288 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.697952 11958 consensus_queue.cc:237] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 288, Committed index: 288, Last appended: 1.288, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 289 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:07.699354 11699 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 288. Preceding OpId from leader: term: 1 index: 289. (index mismatch)
I20240502 20:46:07.699460 12221 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 288. Preceding OpId from leader: term: 1 index: 289. (index mismatch)
I20240502 20:46:07.699612 14496 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 288. Preceding OpId from leader: term: 1 index: 289. (index mismatch)
I20240502 20:46:07.699949 14948 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 289, Last known committed idx: 288, Time since last communication: 0.000s
I20240502 20:46:07.700172 14947 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 289, Last known committed idx: 288, Time since last communication: 0.000s
I20240502 20:46:07.700223 13161 raft_consensus.cc:1261] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 6529b03451c9475ab62c51f71714b0cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 288. Preceding OpId from leader: term: 1 index: 289. (index mismatch)
I20240502 20:46:07.700713 14940 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 289, Last known committed idx: 288, Time since last communication: 0.000s
I20240502 20:46:07.701555 14948 consensus_queue.cc:1035] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 289, Last known committed idx: 288, Time since last communication: 0.000s
I20240502 20:46:07.702615 14940 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf [term 1 LEADER]: Committing config change with OpId 1.289: config changed from index 288 to 289, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 289 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.703900 12221 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.289: config changed from index 288 to 289, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 289 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.703873 13161 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.289: config changed from index 288 to 289, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 289 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.704129 11699 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.289: config changed from index 288 to 289, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 289 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.705457 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8a2169943b994152ba495bdb810754a0 with cas_config_opid_index 288: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:07.706403 14496 raft_consensus.cc:2932] T 8a2169943b994152ba495bdb810754a0 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.289: config changed from index 288 to 289, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New config: { opid_index: 289 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:07.707136 11418 catalog_manager.cc:5484] T 8a2169943b994152ba495bdb810754a0 P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index 288 to 289, VOTER 5521e131639043f8b116f9c71cf4bfee (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "6529b03451c9475ab62c51f71714b0cf" committed_config { opid_index: 289 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:07.709893 11549 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a2169943b994152ba495bdb810754a0 with delete_type TABLET_DATA_TOMBSTONED (TS 5521e131639043f8b116f9c71cf4bfee not found in new config with opid_index 289) from {username='slave'} at 127.0.0.1:60196
I20240502 20:46:07.710538 14966 tablet_replica.cc:330] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee: stopping tablet replica
I20240502 20:46:07.710734 14966 raft_consensus.cc:2229] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:07.711117 14966 raft_consensus.cc:2258] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:07.712817 14966 ts_tablet_manager.cc:1875] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:07.714998 14966 ts_tablet_manager.cc:1888] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.288
I20240502 20:46:07.715073 14966 log.cc:1196] T 8a2169943b994152ba495bdb810754a0 P 5521e131639043f8b116f9c71cf4bfee: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/8a2169943b994152ba495bdb810754a0
I20240502 20:46:07.715592 11413 catalog_manager.cc:4830] TS 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161): tablet 8a2169943b994152ba495bdb810754a0 (table rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]) successfully deleted
I20240502 20:46:07.734350 11699 consensus_queue.cc:237] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 325, Committed index: 325, Last appended: 1.325, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:07.736287 12221 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 325. Preceding OpId from leader: term: 1 index: 326. (index mismatch)
I20240502 20:46:07.736356 11958 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 325. Preceding OpId from leader: term: 1 index: 326. (index mismatch)
I20240502 20:46:07.736389 12094 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 325. Preceding OpId from leader: term: 1 index: 326. (index mismatch)
I20240502 20:46:07.736802 14929 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 326, Last known committed idx: 325, Time since last communication: 0.000s
I20240502 20:46:07.736984 13161 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 325. Preceding OpId from leader: term: 1 index: 326. (index mismatch)
I20240502 20:46:07.737066 14841 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 326, Last known committed idx: 325, Time since last communication: 0.000s
I20240502 20:46:07.737257 14930 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 326, Last known committed idx: 325, Time since last communication: 0.000s
W20240502 20:46:07.737416 11636 consensus_peers.cc:485] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d55d69fcfb44cb29751908f32fb393f. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:07.737506 14842 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 326, Last known committed idx: 325, Time since last communication: 0.000s
I20240502 20:46:07.739995 14929 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.326: config changed from index 92 to 326, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.740727 13161 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.326: config changed from index 92 to 326, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.742988 11958 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.326: config changed from index 92 to 326, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.743077 11423 catalog_manager.cc:5484] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 reported cstate change: config changed from index 92 to 326, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:07.743434 12094 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.326: config changed from index 92 to 326, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.747478 12221 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.326: config changed from index 92 to 326, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.755587 12221 consensus_queue.cc:237] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 326, Committed index: 326, Last appended: 1.326, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:07.757589 12094 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 20:46:07.758008 11958 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 20:46:07.758286 14996 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 20:46:07.758450 11563 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 20:46:07.758767 13161 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 20:46:07.759001 13318 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 20:46:07.759202 14992 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 20:46:07.759562 14997 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 20:46:07.761569 14997 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEADER]: Committing config change with OpId 1.327: config changed from index 151 to 327, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.762621 13161 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 151 to 327, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.762866 11563 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 151 to 327, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.764281 12094 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 151 to 327, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.766124 11417 catalog_manager.cc:5484] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: config changed from index 151 to 327, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "72cfad7451c64ef59a18e09d16a79046" committed_config { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:07.766474 11958 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 151 to 327, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
W20240502 20:46:07.767797 12160 consensus_peers.cc:485] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95c74a872c72447cbf6c77beecf8bf1c. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:07.778486 12094 consensus_queue.cc:237] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 171, Committed index: 171, Last appended: 1.171, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 172 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:07.780887 11563 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 171. Preceding OpId from leader: term: 1 index: 172. (index mismatch)
W20240502 20:46:07.781369 12029 consensus_peers.cc:485] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 319f281517f54ed6998fd74a849b07eb. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:07.781368 11699 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 171. Preceding OpId from leader: term: 1 index: 172. (index mismatch)
I20240502 20:46:07.781812 14844 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 172, Last known committed idx: 171, Time since last communication: 0.000s
I20240502 20:46:07.782395 14412 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 172, Last known committed idx: 171, Time since last communication: 0.000s
I20240502 20:46:07.783799 11958 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 171. Preceding OpId from leader: term: 1 index: 172. (index mismatch)
I20240502 20:46:07.784349 14910 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 172, Last known committed idx: 171, Time since last communication: 0.000s
I20240502 20:46:07.784798 14911 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.172: config changed from index 58 to 172, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 172 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.785272 13161 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 171. Preceding OpId from leader: term: 1 index: 172. (index mismatch)
I20240502 20:46:07.785640 11699 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.172: config changed from index 58 to 172, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 172 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.786710 14707 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 172, Last known committed idx: 171, Time since last communication: 0.000s
I20240502 20:46:07.787989 11563 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.172: config changed from index 58 to 172, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 172 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.788550 13161 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.172: config changed from index 58 to 172, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 172 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.791247 11419 catalog_manager.cc:5484] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee reported cstate change: config changed from index 58 to 172, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 172 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.799129 11958 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.172: config changed from index 58 to 172, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 172 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.805088 11828 consensus_queue.cc:237] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 271, Committed index: 271, Last appended: 1.271, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 272 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:07.807025 12221 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 271. Preceding OpId from leader: term: 1 index: 272. (index mismatch)
I20240502 20:46:07.807025 13161 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 271. Preceding OpId from leader: term: 1 index: 272. (index mismatch)
I20240502 20:46:07.807475 11563 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 271. Preceding OpId from leader: term: 1 index: 272. (index mismatch)
I20240502 20:46:07.807560 14898 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 272, Last known committed idx: 271, Time since last communication: 0.000s
I20240502 20:46:07.807865 12094 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 271. Preceding OpId from leader: term: 1 index: 272. (index mismatch)
W20240502 20:46:07.808243 11767 consensus_peers.cc:485] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2bbffeb3e45e4ab78112632675d55ac6. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:07.808353 14640 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 272, Last known committed idx: 271, Time since last communication: 0.000s
I20240502 20:46:07.808714 14640 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 272, Last known committed idx: 271, Time since last communication: 0.000s
I20240502 20:46:07.809024 14640 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 272, Last known committed idx: 271, Time since last communication: 0.000s
I20240502 20:46:07.811707 14898 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.272: config changed from index 55 to 272, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 272 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.812928 12094 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.272: config changed from index 55 to 272, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 272 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.814008 12221 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.272: config changed from index 55 to 272, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 272 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.814321 11563 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.272: config changed from index 55 to 272, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 272 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.814605 11421 catalog_manager.cc:5484] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 55 to 272, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 272 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:07.815559 13161 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.272: config changed from index 55 to 272, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 272 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.856194 12094 consensus_queue.cc:237] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 205, Committed index: 205, Last appended: 1.205, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:07.858723 12221 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 1 index: 206. (index mismatch)
I20240502 20:46:07.858948 11699 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 1 index: 206. (index mismatch)
I20240502 20:46:07.859445 14707 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 206, Last known committed idx: 205, Time since last communication: 0.000s
I20240502 20:46:07.859810 11958 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 1 index: 206. (index mismatch)
I20240502 20:46:07.859447 13161 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 205. Preceding OpId from leader: term: 1 index: 206. (index mismatch)
I20240502 20:46:07.860355 14707 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 206, Last known committed idx: 205, Time since last communication: 0.000s
I20240502 20:46:07.860569 14910 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 206, Last known committed idx: 205, Time since last communication: 0.000s
W20240502 20:46:07.860739 12029 consensus_peers.cc:485] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136:42479): Couldn't send request to peer d8d4bb7b6d914451a1843b6555e30d2b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed4d27cc41454a108252941a99cd16e2. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:07.861145 14910 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 206, Last known committed idx: 205, Time since last communication: 0.000s
I20240502 20:46:07.863503 14707 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.206: config changed from index 48 to 206, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.863888 12221 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.206: config changed from index 48 to 206, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.865634 11699 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.206: config changed from index 48 to 206, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.866889 11958 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.206: config changed from index 48 to 206, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.867946 11419 catalog_manager.cc:5484] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: config changed from index 48 to 206, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:07.870239 13161 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.206: config changed from index 48 to 206, NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) added. New config: { opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } } }
I20240502 20:46:08.198277 15109 ts_tablet_manager.cc:902] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:46:08.198809 15109 tablet_copy_client.cc:308] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:33233
I20240502 20:46:08.199342 12114 tablet_copy_service.cc:140] P 7dd8e38181f24e349fb179d2a9eb74c1: Received BeginTabletCopySession request for tablet 319f281517f54ed6998fd74a849b07eb from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:59177)
I20240502 20:46:08.199445 12114 tablet_copy_service.cc:161] P 7dd8e38181f24e349fb179d2a9eb74c1: Beginning new tablet copy session on tablet 319f281517f54ed6998fd74a849b07eb from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:59177: session id = d8d4bb7b6d914451a1843b6555e30d2b-319f281517f54ed6998fd74a849b07eb
I20240502 20:46:08.200279 12114 tablet_copy_source_session.cc:205] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:08.201195 15109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 319f281517f54ed6998fd74a849b07eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:08.203661 15109 tablet_copy_client.cc:783] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:08.203840 15109 tablet_copy_client.cc:647] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:08.205597 15109 tablet_copy_client.cc:523] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:08.206797 15109 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:08.208541 15114 ts_tablet_manager.cc:902] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315)
I20240502 20:46:08.209090 15114 tablet_copy_client.cc:308] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:42315
I20240502 20:46:08.209586 11852 tablet_copy_service.cc:140] P 07fe14e7347a4682bd8f6026ad776da3: Received BeginTabletCopySession request for tablet 2bbffeb3e45e4ab78112632675d55ac6 from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:40341)
I20240502 20:46:08.209692 11852 tablet_copy_service.cc:161] P 07fe14e7347a4682bd8f6026ad776da3: Beginning new tablet copy session on tablet 2bbffeb3e45e4ab78112632675d55ac6 from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:40341: session id = d8d4bb7b6d914451a1843b6555e30d2b-2bbffeb3e45e4ab78112632675d55ac6
I20240502 20:46:08.210628 11852 tablet_copy_source_session.cc:205] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:08.211484 15114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbffeb3e45e4ab78112632675d55ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:08.213673 15114 tablet_copy_client.cc:783] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:08.213832 15114 tablet_copy_client.cc:647] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:08.215436 15114 tablet_copy_client.cc:523] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:08.216533 15119 ts_tablet_manager.cc:902] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991)
I20240502 20:46:08.217020 15114 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:08.217113 15119 tablet_copy_client.cc:308] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:43991
I20240502 20:46:08.217605 11721 tablet_copy_service.cc:140] P 8096a2fe270b492baa3178ad9d2976e7: Received BeginTabletCopySession request for tablet 1d55d69fcfb44cb29751908f32fb393f from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:58449)
I20240502 20:46:08.217730 11721 tablet_copy_service.cc:161] P 8096a2fe270b492baa3178ad9d2976e7: Beginning new tablet copy session on tablet 1d55d69fcfb44cb29751908f32fb393f from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:58449: session id = d8d4bb7b6d914451a1843b6555e30d2b-1d55d69fcfb44cb29751908f32fb393f
I20240502 20:46:08.218791 11721 tablet_copy_source_session.cc:205] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:08.219612 15119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d55d69fcfb44cb29751908f32fb393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:08.221276 15119 tablet_copy_client.cc:783] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:08.221443 15119 tablet_copy_client.cc:647] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:08.223208 15119 tablet_copy_client.cc:523] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:08.224488 15119 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:08.263264 15127 ts_tablet_manager.cc:902] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241)
I20240502 20:46:08.264295 15127 tablet_copy_client.cc:308] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.134:41241
I20240502 20:46:08.271584 12245 tablet_copy_service.cc:140] P 72cfad7451c64ef59a18e09d16a79046: Received BeginTabletCopySession request for tablet 95c74a872c72447cbf6c77beecf8bf1c from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:60393)
I20240502 20:46:08.271764 12245 tablet_copy_service.cc:161] P 72cfad7451c64ef59a18e09d16a79046: Beginning new tablet copy session on tablet 95c74a872c72447cbf6c77beecf8bf1c from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:60393: session id = d8d4bb7b6d914451a1843b6555e30d2b-95c74a872c72447cbf6c77beecf8bf1c
I20240502 20:46:08.272572 12245 tablet_copy_source_session.cc:205] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:08.273526 15127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c74a872c72447cbf6c77beecf8bf1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:08.275951 15127 tablet_copy_client.cc:783] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:08.276129 15127 tablet_copy_client.cc:647] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:08.278558 15127 tablet_copy_client.cc:523] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:08.281121 15127 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:08.346086 15109 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=172 overwritten=0 applied=172 ignored=0} inserts{seen=841 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:08.346473 15109 tablet_bootstrap.cc:492] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:08.346699 15109 ts_tablet_manager.cc:1367] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.140s user 0.132s sys 0.004s
I20240502 20:46:08.347174 15109 raft_consensus.cc:348] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 172 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.347316 15109 raft_consensus.cc:729] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:08.347412 15109 consensus_queue.cc:260] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 172, Last appended: 1.172, Last appended by leader: 172, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 172 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.347903 15109 ts_tablet_manager.cc:1398] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:46:08.350564 12114 tablet_copy_service.cc:342] P 7dd8e38181f24e349fb179d2a9eb74c1: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-319f281517f54ed6998fd74a849b07eb received from {username='slave'} at 127.9.82.136:59177
I20240502 20:46:08.350666 12114 tablet_copy_service.cc:433] P 7dd8e38181f24e349fb179d2a9eb74c1: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-319f281517f54ed6998fd74a849b07eb on tablet 319f281517f54ed6998fd74a849b07eb with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:08.382942 15109 ts_tablet_manager.cc:902] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: Initiating tablet copy from peer 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233)
I20240502 20:46:08.383484 15109 tablet_copy_client.cc:308] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:33233
I20240502 20:46:08.384547 12114 tablet_copy_service.cc:140] P 7dd8e38181f24e349fb179d2a9eb74c1: Received BeginTabletCopySession request for tablet ed4d27cc41454a108252941a99cd16e2 from peer d8d4bb7b6d914451a1843b6555e30d2b ({username='slave'} at 127.9.82.136:59177)
I20240502 20:46:08.384675 12114 tablet_copy_service.cc:161] P 7dd8e38181f24e349fb179d2a9eb74c1: Beginning new tablet copy session on tablet ed4d27cc41454a108252941a99cd16e2 from peer d8d4bb7b6d914451a1843b6555e30d2b at {username='slave'} at 127.9.82.136:59177: session id = d8d4bb7b6d914451a1843b6555e30d2b-ed4d27cc41454a108252941a99cd16e2
I20240502 20:46:08.385687 12114 tablet_copy_source_session.cc:205] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:08.386925 15109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed4d27cc41454a108252941a99cd16e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:08.389153 15109 tablet_copy_client.cc:783] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:08.391252 15109 tablet_copy_client.cc:647] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:08.393069 15109 tablet_copy_client.cc:523] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:08.394378 15109 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap starting.
I20240502 20:46:08.488473 15114 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=272 overwritten=0 applied=272 ignored=0} inserts{seen=900 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:08.488862 15114 tablet_bootstrap.cc:492] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:08.489107 15114 ts_tablet_manager.cc:1367] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.272s user 0.190s sys 0.016s
I20240502 20:46:08.491611 15119 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=326 overwritten=0 applied=326 ignored=0} inserts{seen=954 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:08.492004 15119 tablet_bootstrap.cc:492] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:08.492233 15119 ts_tablet_manager.cc:1367] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.268s user 0.221s sys 0.009s
I20240502 20:46:08.492717 15119 raft_consensus.cc:348] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.492868 15119 raft_consensus.cc:729] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:08.493077 15114 raft_consensus.cc:348] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 272 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.493191 15114 raft_consensus.cc:729] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:08.493300 15114 consensus_queue.cc:260] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 272, Last appended: 1.272, Last appended by leader: 272, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 272 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.493623 15114 ts_tablet_manager.cc:1398] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240502 20:46:08.494259 11852 tablet_copy_service.cc:342] P 07fe14e7347a4682bd8f6026ad776da3: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-2bbffeb3e45e4ab78112632675d55ac6 received from {username='slave'} at 127.9.82.136:40341
I20240502 20:46:08.494350 11852 tablet_copy_service.cc:433] P 07fe14e7347a4682bd8f6026ad776da3: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-2bbffeb3e45e4ab78112632675d55ac6 on tablet 2bbffeb3e45e4ab78112632675d55ac6 with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:08.494298 15119 consensus_queue.cc:260] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 326, Last appended: 1.326, Last appended by leader: 326, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.494591 15119 ts_tablet_manager.cc:1398] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:46:08.495682 11721 tablet_copy_service.cc:342] P 8096a2fe270b492baa3178ad9d2976e7: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-1d55d69fcfb44cb29751908f32fb393f received from {username='slave'} at 127.9.82.136:58449
I20240502 20:46:08.495811 11721 tablet_copy_service.cc:433] P 8096a2fe270b492baa3178ad9d2976e7: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-1d55d69fcfb44cb29751908f32fb393f on tablet 1d55d69fcfb44cb29751908f32fb393f with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:08.546339 15127 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=327 overwritten=0 applied=327 ignored=0} inserts{seen=996 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:08.546679 15127 tablet_bootstrap.cc:492] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:08.546929 15127 ts_tablet_manager.cc:1367] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.266s user 0.229s sys 0.009s
I20240502 20:46:08.547441 15127 raft_consensus.cc:348] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.547600 15127 raft_consensus.cc:729] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:08.547761 15127 consensus_queue.cc:260] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 327, Last appended: 1.327, Last appended by leader: 327, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.548069 15127 ts_tablet_manager.cc:1398] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:46:08.548635 12245 tablet_copy_service.cc:342] P 72cfad7451c64ef59a18e09d16a79046: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-95c74a872c72447cbf6c77beecf8bf1c received from {username='slave'} at 127.9.82.136:60393
I20240502 20:46:08.548743 12245 tablet_copy_service.cc:433] P 72cfad7451c64ef59a18e09d16a79046: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-95c74a872c72447cbf6c77beecf8bf1c on tablet 95c74a872c72447cbf6c77beecf8bf1c with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:08.577718 15109 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=206 overwritten=0 applied=206 ignored=0} inserts{seen=875 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:08.578042 15109 tablet_bootstrap.cc:492] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: Bootstrap complete.
I20240502 20:46:08.578292 15109 ts_tablet_manager.cc:1367] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent bootstrapping tablet: real 0.184s user 0.148s sys 0.008s
I20240502 20:46:08.578775 15109 raft_consensus.cc:348] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.578944 15109 raft_consensus.cc:729] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d8d4bb7b6d914451a1843b6555e30d2b, State: Initialized, Role: LEARNER
I20240502 20:46:08.579075 15109 consensus_queue.cc:260] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 206, Last appended: 1.206, Last appended by leader: 206, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 206 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: true } }
I20240502 20:46:08.579378 15109 ts_tablet_manager.cc:1398] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:08.580001 12114 tablet_copy_service.cc:342] P 7dd8e38181f24e349fb179d2a9eb74c1: Request end of tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-ed4d27cc41454a108252941a99cd16e2 received from {username='slave'} at 127.9.82.136:59177
I20240502 20:46:08.580094 12114 tablet_copy_service.cc:433] P 7dd8e38181f24e349fb179d2a9eb74c1: ending tablet copy session d8d4bb7b6d914451a1843b6555e30d2b-ed4d27cc41454a108252941a99cd16e2 on tablet ed4d27cc41454a108252941a99cd16e2 with peer d8d4bb7b6d914451a1843b6555e30d2b
I20240502 20:46:08.677624 14496 raft_consensus.cc:1203] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.171->[1.172-1.172] Dedup: 1.172->[]
I20240502 20:46:08.706954 14496 raft_consensus.cc:1203] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.325->[1.326-1.326] Dedup: 1.326->[]
I20240502 20:46:08.759174 14496 raft_consensus.cc:1203] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.271->[1.272-1.272] Dedup: 1.272->[]
I20240502 20:46:08.775609 14496 raft_consensus.cc:1203] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.326->[1.327-1.327] Dedup: 1.327->[]
I20240502 20:46:09.002517 14496 raft_consensus.cc:1203] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.205->[1.206-1.206] Dedup: 1.206->[]
I20240502 20:46:09.177386 14911 raft_consensus.cc:1050] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:09.177902 14911 consensus_queue.cc:237] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 172, Committed index: 172, Last appended: 1.172, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 173 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.179601 11563 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 172. Preceding OpId from leader: term: 1 index: 173. (index mismatch)
I20240502 20:46:09.179814 14496 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 172. Preceding OpId from leader: term: 1 index: 173. (index mismatch)
I20240502 20:46:09.180233 11699 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 172. Preceding OpId from leader: term: 1 index: 173. (index mismatch)
I20240502 20:46:09.180322 13161 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 172. Preceding OpId from leader: term: 1 index: 173. (index mismatch)
I20240502 20:46:09.180517 11958 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 172. Preceding OpId from leader: term: 1 index: 173. (index mismatch)
I20240502 20:46:09.181174 14707 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 173, Last known committed idx: 172, Time since last communication: 0.000s
I20240502 20:46:09.181344 14911 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 173, Last known committed idx: 172, Time since last communication: 0.000s
I20240502 20:46:09.181474 15245 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 173, Last known committed idx: 172, Time since last communication: 0.000s
I20240502 20:46:09.181896 15245 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 173, Last known committed idx: 172, Time since last communication: 0.000s
I20240502 20:46:09.182045 14911 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 173, Last known committed idx: 172, Time since last communication: 0.000s
I20240502 20:46:09.185550 14707 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.173: config changed from index 172 to 173, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 173 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.185982 11699 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.173: config changed from index 172 to 173, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 173 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.188561 11421 catalog_manager.cc:5484] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 172 to 173, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 173 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:09.188853 15190 raft_consensus.cc:1050] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:09.189352 15190 consensus_queue.cc:237] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 326, Committed index: 326, Last appended: 1.326, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.189675 13161 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.173: config changed from index 172 to 173, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 173 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.191099 14496 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 20:46:09.191284 12224 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 20:46:09.191385 12094 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 20:46:09.191825 15191 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 20:46:09.191941 14496 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.173: config changed from index 172 to 173, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 173 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.192184 15191 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 20:46:09.192445 14930 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 20:46:09.193524 13161 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 20:46:09.194126 11958 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 20:46:09.194351 11962 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.173: config changed from index 172 to 173, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 173 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.194792 15258 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 20:46:09.195602 15257 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 20:46:09.198199 15190 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.327: config changed from index 326 to 327, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.198980 14498 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.200320 11962 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.200389 12224 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.201015 13161 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.202955 12094 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.203167 11418 catalog_manager.cc:5484] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 reported cstate change: config changed from index 326 to 327, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false replace: true } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.206127 11563 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.173: config changed from index 172 to 173, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 173 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } attrs { replace: true } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.211293 11699 consensus_queue.cc:237] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 327, Committed index: 327, Last appended: 1.327, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.213011 14498 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 20:46:09.213411 12224 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 20:46:09.213462 15257 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 20:46:09.213793 15256 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 20:46:09.213960 11962 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 20:46:09.214457 15256 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 20:46:09.214880 12090 raft_consensus.cc:1261] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 8096a2fe270b492baa3178ad9d2976e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 20:46:09.215530 15257 consensus_queue.cc:1035] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 20:46:09.215934 15256 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 8096a2fe270b492baa3178ad9d2976e7 [term 1 LEADER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.216265 14995 raft_consensus.cc:1050] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:09.216622 14995 consensus_queue.cc:237] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 327, Committed index: 327, Last appended: 1.327, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.218093 14498 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.218472 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1d55d69fcfb44cb29751908f32fb393f with cas_config_opid_index 327: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:09.218555 13161 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 20:46:09.219143 11962 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.219375 11958 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 20:46:09.219414 12091 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 20:46:09.219792 14496 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 20:46:09.220283 12090 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.220739 12224 raft_consensus.cc:2932] T 1d55d69fcfb44cb29751908f32fb393f P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.221729 11423 catalog_manager.cc:5484] T 1d55d69fcfb44cb29751908f32fb393f P d8d4bb7b6d914451a1843b6555e30d2b reported cstate change: config changed from index 327 to 328, VOTER 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135) evicted. New cstate: current_term: 1 leader_uuid: "8096a2fe270b492baa3178ad9d2976e7" committed_config { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.222087 11563 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 20:46:09.222637 15193 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 20:46:09.223001 15193 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 20:46:09.223323 15193 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 20:46:09.223651 15193 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 20:46:09.223987 15193 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 20:46:09.226140 12094 consensus_queue.cc:237] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 173, Committed index: 173, Last appended: 1.173, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.227963 11569 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 173. Preceding OpId from leader: term: 1 index: 174. (index mismatch)
I20240502 20:46:09.227959 13148 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 173. Preceding OpId from leader: term: 1 index: 174. (index mismatch)
I20240502 20:46:09.228353 15245 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 174, Last known committed idx: 173, Time since last communication: 0.000s
I20240502 20:46:09.228412 14496 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 173. Preceding OpId from leader: term: 1 index: 174. (index mismatch)
I20240502 20:46:09.228993 15246 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 174, Last known committed idx: 173, Time since last communication: 0.000s
I20240502 20:46:09.229285 11699 raft_consensus.cc:1261] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 173. Preceding OpId from leader: term: 1 index: 174. (index mismatch)
I20240502 20:46:09.229625 15193 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEADER]: Committing config change with OpId 1.328: config changed from index 327 to 328, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.229851 15245 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 174, Last known committed idx: 173, Time since last communication: 0.000s
I20240502 20:46:09.230185 15245 consensus_queue.cc:1035] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 174, Last known committed idx: 173, Time since last communication: 0.000s
I20240502 20:46:09.232457 14496 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.232960 11962 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.234122 15245 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.174: config changed from index 173 to 174, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.235251 13161 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.235740 11422 catalog_manager.cc:5484] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b reported cstate change: config changed from index 327 to 328, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "72cfad7451c64ef59a18e09d16a79046" committed_config { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.236129 11563 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.236583 11699 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.174: config changed from index 173 to 174, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.237601 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 319f281517f54ed6998fd74a849b07eb with cas_config_opid_index 173: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:09.238919 14496 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.174: config changed from index 173 to 174, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.239081 11421 catalog_manager.cc:5484] T 319f281517f54ed6998fd74a849b07eb P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 173 to 174, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:09.240372 13161 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.174: config changed from index 173 to 174, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.242409 12091 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } attrs { replace: true } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.243119 11941 tablet_service.cc:1514] Processing DeleteTablet for tablet 319f281517f54ed6998fd74a849b07eb with delete_type TABLET_DATA_TOMBSTONED (TS 6529b03451c9475ab62c51f71714b0cf not found in new config with opid_index 174) from {username='slave'} at 127.0.0.1:39680
I20240502 20:46:09.243461 11569 raft_consensus.cc:2932] T 319f281517f54ed6998fd74a849b07eb P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.174: config changed from index 173 to 174, VOTER 6529b03451c9475ab62c51f71714b0cf (127.9.82.132) evicted. New config: { opid_index: 174 OBSOLETE_local: false peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.248195 13143 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d55d69fcfb44cb29751908f32fb393f with delete_type TABLET_DATA_TOMBSTONED (TS 8824a7df8ec9431db37c0bb434ede060 not found in new config with opid_index 328) from {username='slave'} at 127.0.0.1:42156
I20240502 20:46:09.248314 15282 tablet_replica.cc:330] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf: stopping tablet replica
I20240502 20:46:09.248493 15282 raft_consensus.cc:2229] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:09.248783 15282 raft_consensus.cc:2258] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:09.248871 12224 consensus_queue.cc:237] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 328, Committed index: 328, Last appended: 1.328, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 329 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.248992 15283 tablet_replica.cc:330] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: stopping tablet replica
I20240502 20:46:09.249341 15283 raft_consensus.cc:2229] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:09.250053 15283 raft_consensus.cc:2258] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:09.250466 14496 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 328. Preceding OpId from leader: term: 1 index: 329. (index mismatch)
I20240502 20:46:09.250491 11962 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 328. Preceding OpId from leader: term: 1 index: 329. (index mismatch)
I20240502 20:46:09.250850 13161 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 328. Preceding OpId from leader: term: 1 index: 329. (index mismatch)
I20240502 20:46:09.250861 11569 raft_consensus.cc:1261] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 72cfad7451c64ef59a18e09d16a79046: Log matching property violated. Preceding OpId in replica: term: 1 index: 328. Preceding OpId from leader: term: 1 index: 329. (index mismatch)
I20240502 20:46:09.250941 15274 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 329, Last known committed idx: 328, Time since last communication: 0.000s
I20240502 20:46:09.251349 15274 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 329, Last known committed idx: 328, Time since last communication: 0.000s
I20240502 20:46:09.251502 15272 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 329, Last known committed idx: 328, Time since last communication: 0.000s
I20240502 20:46:09.251670 15271 consensus_queue.cc:1035] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 329, Last known committed idx: 328, Time since last communication: 0.000s
I20240502 20:46:09.252077 15282 ts_tablet_manager.cc:1875] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:09.253898 15272 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 72cfad7451c64ef59a18e09d16a79046 [term 1 LEADER]: Committing config change with OpId 1.329: config changed from index 328 to 329, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 329 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.254773 15282 ts_tablet_manager.cc:1888] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.173
I20240502 20:46:09.254801 15283 ts_tablet_manager.cc:1875] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:09.254912 15282 log.cc:1196] T 319f281517f54ed6998fd74a849b07eb P 6529b03451c9475ab62c51f71714b0cf: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/319f281517f54ed6998fd74a849b07eb
I20240502 20:46:09.255043 11962 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.329: config changed from index 328 to 329, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 329 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.256209 11411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 95c74a872c72447cbf6c77beecf8bf1c with cas_config_opid_index 328: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:09.256552 11413 catalog_manager.cc:4830] TS 6529b03451c9475ab62c51f71714b0cf (127.9.82.132:35493): tablet 319f281517f54ed6998fd74a849b07eb (table rebalance_test_table_2 [id=8692bbc8498d4349be9f1249324c8322]) successfully deleted
I20240502 20:46:09.257200 15283 ts_tablet_manager.cc:1888] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.327
I20240502 20:46:09.257318 15283 log.cc:1196] T 1d55d69fcfb44cb29751908f32fb393f P 8824a7df8ec9431db37c0bb434ede060: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/wals/1d55d69fcfb44cb29751908f32fb393f
I20240502 20:46:09.257228 11569 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.329: config changed from index 328 to 329, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 329 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.257721 13161 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.329: config changed from index 328 to 329, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 329 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.257743 11419 catalog_manager.cc:5484] T 95c74a872c72447cbf6c77beecf8bf1c P 6529b03451c9475ab62c51f71714b0cf reported cstate change: config changed from index 328 to 329, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "72cfad7451c64ef59a18e09d16a79046" committed_config { opid_index: 329 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.258543 14496 raft_consensus.cc:2932] T 95c74a872c72447cbf6c77beecf8bf1c P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.329: config changed from index 328 to 329, VOTER 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133) evicted. New config: { opid_index: 329 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.258839 11412 catalog_manager.cc:4830] TS 8824a7df8ec9431db37c0bb434ede060 (127.9.82.135:44285): tablet 1d55d69fcfb44cb29751908f32fb393f (table rebalance_test_table_3 [id=3bb7f1c7d1784156bcc791c4fa43edb7]) successfully deleted
I20240502 20:46:09.261026 12073 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c74a872c72447cbf6c77beecf8bf1c with delete_type TABLET_DATA_TOMBSTONED (TS 7dd8e38181f24e349fb179d2a9eb74c1 not found in new config with opid_index 329) from {username='slave'} at 127.0.0.1:51414
I20240502 20:46:09.262634 15284 tablet_replica.cc:330] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1: stopping tablet replica
I20240502 20:46:09.262805 15284 raft_consensus.cc:2229] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:09.263134 15284 raft_consensus.cc:2258] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:09.264756 15284 ts_tablet_manager.cc:1875] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:09.266505 15284 ts_tablet_manager.cc:1888] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.328
I20240502 20:46:09.266572 15284 log.cc:1196] T 95c74a872c72447cbf6c77beecf8bf1c P 7dd8e38181f24e349fb179d2a9eb74c1: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/95c74a872c72447cbf6c77beecf8bf1c
I20240502 20:46:09.267113 11413 catalog_manager.cc:4830] TS 7dd8e38181f24e349fb179d2a9eb74c1 (127.9.82.133:33233): tablet 95c74a872c72447cbf6c77beecf8bf1c (table rebalance_test_table_4 [id=846fab8a027449f4b9c1d7ac8aa764a4]) successfully deleted
I20240502 20:46:09.305140 15192 raft_consensus.cc:1050] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:09.305610 15192 consensus_queue.cc:237] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 272, Committed index: 272, Last appended: 1.272, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 273 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.307197 13161 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 272. Preceding OpId from leader: term: 1 index: 273. (index mismatch)
I20240502 20:46:09.307307 14496 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 272. Preceding OpId from leader: term: 1 index: 273. (index mismatch)
I20240502 20:46:09.307516 12224 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 272. Preceding OpId from leader: term: 1 index: 273. (index mismatch)
I20240502 20:46:09.307520 12091 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 272. Preceding OpId from leader: term: 1 index: 273. (index mismatch)
I20240502 20:46:09.307590 11569 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 272. Preceding OpId from leader: term: 1 index: 273. (index mismatch)
I20240502 20:46:09.307767 14640 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 273, Last known committed idx: 272, Time since last communication: 0.000s
I20240502 20:46:09.308053 15287 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 273, Last known committed idx: 272, Time since last communication: 0.000s
I20240502 20:46:09.308329 14640 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 273, Last known committed idx: 272, Time since last communication: 0.000s
I20240502 20:46:09.308665 15192 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 273, Last known committed idx: 272, Time since last communication: 0.000s
I20240502 20:46:09.308907 14640 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 273, Last known committed idx: 272, Time since last communication: 0.000s
I20240502 20:46:09.311152 15288 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.273: config changed from index 272 to 273, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 273 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.311568 14496 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.273: config changed from index 272 to 273, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 273 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.311627 12224 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.273: config changed from index 272 to 273, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 273 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.313073 13161 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.273: config changed from index 272 to 273, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 273 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.313800 12091 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.273: config changed from index 272 to 273, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 273 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.316067 11419 catalog_manager.cc:5484] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 272 to 273, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 273 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:09.316390 11569 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.273: config changed from index 272 to 273, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 273 OBSOLETE_local: false peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } attrs { replace: true } } peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.319656 11828 consensus_queue.cc:237] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 273, Committed index: 273, Last appended: 1.273, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 274 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.321676 12091 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 273. Preceding OpId from leader: term: 1 index: 274. (index mismatch)
I20240502 20:46:09.321759 11569 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 273. Preceding OpId from leader: term: 1 index: 274. (index mismatch)
I20240502 20:46:09.321965 13161 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 273. Preceding OpId from leader: term: 1 index: 274. (index mismatch)
I20240502 20:46:09.322062 14496 raft_consensus.cc:1261] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 07fe14e7347a4682bd8f6026ad776da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 273. Preceding OpId from leader: term: 1 index: 274. (index mismatch)
I20240502 20:46:09.322322 15192 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 274, Last known committed idx: 273, Time since last communication: 0.000s
I20240502 20:46:09.322491 14640 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 274, Last known committed idx: 273, Time since last communication: 0.000s
I20240502 20:46:09.322643 15286 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 274, Last known committed idx: 273, Time since last communication: 0.000s
I20240502 20:46:09.322788 15287 consensus_queue.cc:1035] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 274, Last known committed idx: 273, Time since last communication: 0.000s
I20240502 20:46:09.325171 14640 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 [term 1 LEADER]: Committing config change with OpId 1.274: config changed from index 273 to 274, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 274 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.325822 12090 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 FOLLOWER]: Committing config change with OpId 1.274: config changed from index 273 to 274, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 274 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.326736 13161 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.274: config changed from index 273 to 274, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 274 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.327446 11411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2bbffeb3e45e4ab78112632675d55ac6 with cas_config_opid_index 273: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:09.327267 11563 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P 5521e131639043f8b116f9c71cf4bfee [term 1 FOLLOWER]: Committing config change with OpId 1.274: config changed from index 273 to 274, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 274 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.329068 11422 catalog_manager.cc:5484] T 2bbffeb3e45e4ab78112632675d55ac6 P 07fe14e7347a4682bd8f6026ad776da3 reported cstate change: config changed from index 273 to 274, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New cstate: current_term: 1 leader_uuid: "07fe14e7347a4682bd8f6026ad776da3" committed_config { opid_index: 274 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:09.331302 14496 raft_consensus.cc:2932] T 2bbffeb3e45e4ab78112632675d55ac6 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.274: config changed from index 273 to 274, VOTER 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134) evicted. New config: { opid_index: 274 OBSOLETE_local: false peers { permanent_uuid: "5521e131639043f8b116f9c71cf4bfee" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 36161 } } peers { permanent_uuid: "07fe14e7347a4682bd8f6026ad776da3" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 42315 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.333309 12205 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bbffeb3e45e4ab78112632675d55ac6 with delete_type TABLET_DATA_TOMBSTONED (TS 72cfad7451c64ef59a18e09d16a79046 not found in new config with opid_index 274) from {username='slave'} at 127.0.0.1:36220
I20240502 20:46:09.333786 15294 tablet_replica.cc:330] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046: stopping tablet replica
I20240502 20:46:09.333943 15294 raft_consensus.cc:2229] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:09.334210 15294 raft_consensus.cc:2258] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:09.336418 15294 ts_tablet_manager.cc:1875] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:09.338389 15294 ts_tablet_manager.cc:1888] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.273
I20240502 20:46:09.338485 15294 log.cc:1196] T 2bbffeb3e45e4ab78112632675d55ac6 P 72cfad7451c64ef59a18e09d16a79046: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/wals/2bbffeb3e45e4ab78112632675d55ac6
I20240502 20:46:09.339208 11411 catalog_manager.cc:4830] TS 72cfad7451c64ef59a18e09d16a79046 (127.9.82.134:41241): tablet 2bbffeb3e45e4ab78112632675d55ac6 (table rebalance_test_table_1 [id=325ff00671e5405b9f50dbdea2bf7988]) successfully deleted
I20240502 20:46:09.550482 15247 raft_consensus.cc:1050] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1: attempting to promote NON_VOTER d8d4bb7b6d914451a1843b6555e30d2b to VOTER
I20240502 20:46:09.550972 15247 consensus_queue.cc:237] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 206, Committed index: 206, Last appended: 1.206, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.552784 14496 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 LEARNER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 1 index: 207. (index mismatch)
I20240502 20:46:09.552983 13161 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 1 index: 207. (index mismatch)
I20240502 20:46:09.553155 12224 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 1 index: 207. (index mismatch)
I20240502 20:46:09.553218 11699 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 1 index: 207. (index mismatch)
I20240502 20:46:09.553402 11962 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 1 index: 207. (index mismatch)
I20240502 20:46:09.553542 15246 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20240502 20:46:09.553807 15247 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20240502 20:46:09.553944 15246 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20240502 20:46:09.554334 15245 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20240502 20:46:09.554898 15245 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20240502 20:46:09.557155 15247 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.207: config changed from index 206 to 207, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.557523 12224 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.207: config changed from index 206 to 207, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.557765 13161 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.207: config changed from index 206 to 207, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.559826 11699 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Committing config change with OpId 1.207: config changed from index 206 to 207, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.560492 14496 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.207: config changed from index 206 to 207, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.560863 11418 catalog_manager.cc:5484] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 206 to 207, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:09.563545 11962 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.207: config changed from index 206 to 207, d8d4bb7b6d914451a1843b6555e30d2b (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "8096a2fe270b492baa3178ad9d2976e7" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 43991 } attrs { replace: true } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.567188 12090 consensus_queue.cc:237] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 207, Committed index: 207, Last appended: 1.207, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } }
I20240502 20:46:09.568676 12224 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 207. Preceding OpId from leader: term: 1 index: 208. (index mismatch)
I20240502 20:46:09.568879 11962 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 207. Preceding OpId from leader: term: 1 index: 208. (index mismatch)
I20240502 20:46:09.569044 15246 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20240502 20:46:09.569208 14911 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20240502 20:46:09.570799 15246 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [term 1 LEADER]: Committing config change with OpId 1.208: config changed from index 207 to 208, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.571204 11962 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 6529b03451c9475ab62c51f71714b0cf [term 1 FOLLOWER]: Committing config change with OpId 1.208: config changed from index 207 to 208, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.572221 14496 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 207. Preceding OpId from leader: term: 1 index: 208. (index mismatch)
I20240502 20:46:09.572525 11413 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ed4d27cc41454a108252941a99cd16e2 with cas_config_opid_index 207: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:09.572654 13161 raft_consensus.cc:1261] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Refusing update from remote peer 7dd8e38181f24e349fb179d2a9eb74c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 207. Preceding OpId from leader: term: 1 index: 208. (index mismatch)
I20240502 20:46:09.572659 15245 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20240502 20:46:09.572916 12224 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 72cfad7451c64ef59a18e09d16a79046 [term 1 FOLLOWER]: Committing config change with OpId 1.208: config changed from index 207 to 208, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.573329 15245 consensus_queue.cc:1035] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 208, Last known committed idx: 207, Time since last communication: 0.000s
I20240502 20:46:09.574193 11417 catalog_manager.cc:5484] T ed4d27cc41454a108252941a99cd16e2 P 7dd8e38181f24e349fb179d2a9eb74c1 reported cstate change: config changed from index 207 to 208, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" committed_config { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:09.574481 13148 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P 8824a7df8ec9431db37c0bb434ede060 [term 1 FOLLOWER]: Committing config change with OpId 1.208: config changed from index 207 to 208, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.576965 14496 raft_consensus.cc:2932] T ed4d27cc41454a108252941a99cd16e2 P d8d4bb7b6d914451a1843b6555e30d2b [term 1 FOLLOWER]: Committing config change with OpId 1.208: config changed from index 207 to 208, VOTER 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130) evicted. New config: { opid_index: 208 OBSOLETE_local: false peers { permanent_uuid: "6529b03451c9475ab62c51f71714b0cf" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 35493 } } peers { permanent_uuid: "72cfad7451c64ef59a18e09d16a79046" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 41241 } } peers { permanent_uuid: "7dd8e38181f24e349fb179d2a9eb74c1" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 33233 } } peers { permanent_uuid: "8824a7df8ec9431db37c0bb434ede060" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 44285 } attrs { promote: false } } peers { permanent_uuid: "d8d4bb7b6d914451a1843b6555e30d2b" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 42479 } attrs { promote: false } } }
I20240502 20:46:09.578411 11680 tablet_service.cc:1514] Processing DeleteTablet for tablet ed4d27cc41454a108252941a99cd16e2 with delete_type TABLET_DATA_TOMBSTONED (TS 8096a2fe270b492baa3178ad9d2976e7 not found in new config with opid_index 208) from {username='slave'} at 127.0.0.1:40458
I20240502 20:46:09.578889 15331 tablet_replica.cc:330] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7: stopping tablet replica
I20240502 20:46:09.579053 15331 raft_consensus.cc:2229] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:09.579286 15331 raft_consensus.cc:2258] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:09.581041 15331 ts_tablet_manager.cc:1875] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:09.582790 15331 ts_tablet_manager.cc:1888] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.207
I20240502 20:46:09.582859 15331 log.cc:1196] T ed4d27cc41454a108252941a99cd16e2 P 8096a2fe270b492baa3178ad9d2976e7: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/ed4d27cc41454a108252941a99cd16e2
I20240502 20:46:09.583381 11413 catalog_manager.cc:4830] TS 8096a2fe270b492baa3178ad9d2976e7 (127.9.82.130:43991): tablet ed4d27cc41454a108252941a99cd16e2 (table rebalance_test_table_0 [id=0e9e71c37052426984ffcf96e6056d2c]) successfully deleted
I20240502 20:46:09.657562 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:09.662092 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:09.664302 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:09.667055 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:46:09.678742 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:09.686329 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:09.698992 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:09.700454 14478 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:09.804508 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:09.812810 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:09.819172 14478 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:09.822140 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:46:09.825055 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:09.831796 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:09.836491 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:09.847558 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:09.954197 13143 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:09.954217 12205 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:09.954217 11549 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:09.963956 11680 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:09.969122 11810 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:46:09.971879 11941 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:09.989549 12073 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:10.003304 14478 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
5386a2faaac64ec7b5ca5c0b90daa78b | 127.9.82.190:43461 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
allow_unsafe_replication_factor | true | runtime,unsafe | all 1 server(s) checked
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+--------------------+-------------------------
builtin_ntp_servers | 127.9.82.148:40229 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
07fe14e7347a4682bd8f6026ad776da3 | 127.9.82.131:42315 | HEALTHY | <none> | 5 | 0
5521e131639043f8b116f9c71cf4bfee | 127.9.82.129:36161 | HEALTHY | <none> | 0 | 0
6529b03451c9475ab62c51f71714b0cf | 127.9.82.132:35493 | HEALTHY | <none> | 2 | 0
72cfad7451c64ef59a18e09d16a79046 | 127.9.82.134:41241 | HEALTHY | <none> | 3 | 0
7dd8e38181f24e349fb179d2a9eb74c1 | 127.9.82.133:33233 | HEALTHY | <none> | 4 | 0
8096a2fe270b492baa3178ad9d2976e7 | 127.9.82.130:43991 | HEALTHY | <none> | 2 | 0
8824a7df8ec9431db37c0bb434ede060 | 127.9.82.135:44285 | HEALTHY | <none> | 0 | 0
d8d4bb7b6d914451a1843b6555e30d2b | 127.9.82.136:42479 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 8
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 8 server(s) checked
local_ip_for_outbound_sockets | 127.9.82.129 | experimental | 127.9.82.129:36161
local_ip_for_outbound_sockets | 127.9.82.130 | experimental | 127.9.82.130:43991
local_ip_for_outbound_sockets | 127.9.82.131 | experimental | 127.9.82.131:42315
local_ip_for_outbound_sockets | 127.9.82.132 | experimental | 127.9.82.132:35493
local_ip_for_outbound_sockets | 127.9.82.133 | experimental | 127.9.82.133:33233
local_ip_for_outbound_sockets | 127.9.82.134 | experimental | 127.9.82.134:41241
local_ip_for_outbound_sockets | 127.9.82.135 | experimental | 127.9.82.135:44285
local_ip_for_outbound_sockets | 127.9.82.136 | experimental | 127.9.82.136:42479
never_fsync | true | unsafe,advanced | all 8 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 8 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 8 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 8 server(s) checked
server_dump_info_format | pb | hidden | all 8 server(s) checked
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.9.82.129:36161
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.9.82.130:43991
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.9.82.131:42315
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.9.82.132:35493
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.9.82.133:33233
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.9.82.134:41241
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.9.82.135:44285
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb | hidden | 127.9.82.136:42479
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+--------------------+-------------------------
builtin_ntp_servers | 127.9.82.148:40229 | all 8 server(s) checked
time_source | builtin | all 8 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 9 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 5 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 10
First Quartile | 10
Median | 10
Third Quartile | 10
Maximum | 10
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 8
Tables | 6
Tablets | 16
Replicas | 80
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20240502 20:46:10.030211 9546 log_verifier.cc:126] Checking tablet 011b3f9ecb524a54a242425725b72706
I20240502 20:46:10.126714 9546 log_verifier.cc:177] Verified matching terms for 192 ops in tablet 011b3f9ecb524a54a242425725b72706
I20240502 20:46:10.126855 9546 log_verifier.cc:126] Checking tablet 067f71582a514a66a0b3fc4681a84471
I20240502 20:46:10.245225 9546 log_verifier.cc:177] Verified matching terms for 256 ops in tablet 067f71582a514a66a0b3fc4681a84471
I20240502 20:46:10.245420 9546 log_verifier.cc:126] Checking tablet 1d55d69fcfb44cb29751908f32fb393f
I20240502 20:46:10.394904 9546 log_verifier.cc:177] Verified matching terms for 328 ops in tablet 1d55d69fcfb44cb29751908f32fb393f
I20240502 20:46:10.395145 9546 log_verifier.cc:126] Checking tablet 2bbffeb3e45e4ab78112632675d55ac6
I20240502 20:46:10.517781 9546 log_verifier.cc:177] Verified matching terms for 274 ops in tablet 2bbffeb3e45e4ab78112632675d55ac6
I20240502 20:46:10.518023 9546 log_verifier.cc:126] Checking tablet 319f281517f54ed6998fd74a849b07eb
I20240502 20:46:10.618175 9546 log_verifier.cc:177] Verified matching terms for 174 ops in tablet 319f281517f54ed6998fd74a849b07eb
I20240502 20:46:10.618321 9546 log_verifier.cc:126] Checking tablet 7261de9012914524a7c43551687fdc0b
I20240502 20:46:10.747984 9546 log_verifier.cc:177] Verified matching terms for 287 ops in tablet 7261de9012914524a7c43551687fdc0b
I20240502 20:46:10.748162 9546 log_verifier.cc:126] Checking tablet 81c3873a4eab471da0c19e8bf0eaf03d
I20240502 20:46:10.837249 9546 log_verifier.cc:177] Verified matching terms for 167 ops in tablet 81c3873a4eab471da0c19e8bf0eaf03d
I20240502 20:46:10.837404 9546 log_verifier.cc:126] Checking tablet 897d8b67ce50427885a7ff494d509b13
I20240502 20:46:10.972604 9546 log_verifier.cc:177] Verified matching terms for 300 ops in tablet 897d8b67ce50427885a7ff494d509b13
I20240502 20:46:10.972842 9546 log_verifier.cc:126] Checking tablet 8a2169943b994152ba495bdb810754a0
I20240502 20:46:11.102975 9546 log_verifier.cc:177] Verified matching terms for 289 ops in tablet 8a2169943b994152ba495bdb810754a0
I20240502 20:46:11.103209 9546 log_verifier.cc:126] Checking tablet 959ee5415c0a44bbaf7bb3a1ba870902
I20240502 20:46:11.132638 9546 log_verifier.cc:177] Verified matching terms for 7 ops in tablet 959ee5415c0a44bbaf7bb3a1ba870902
I20240502 20:46:11.132722 9546 log_verifier.cc:126] Checking tablet 95c74a872c72447cbf6c77beecf8bf1c
I20240502 20:46:11.281821 9546 log_verifier.cc:177] Verified matching terms for 329 ops in tablet 95c74a872c72447cbf6c77beecf8bf1c
I20240502 20:46:11.282065 9546 log_verifier.cc:126] Checking tablet c3a361785bd34a5092f09a53c14ccddd
I20240502 20:46:11.428707 9546 log_verifier.cc:177] Verified matching terms for 322 ops in tablet c3a361785bd34a5092f09a53c14ccddd
I20240502 20:46:11.428946 9546 log_verifier.cc:126] Checking tablet cb2ea660d9044aa7a565ab0c19601244
I20240502 20:46:11.518827 9546 log_verifier.cc:177] Verified matching terms for 185 ops in tablet cb2ea660d9044aa7a565ab0c19601244
I20240502 20:46:11.519008 9546 log_verifier.cc:126] Checking tablet d2a72d81232b487ea716903ddb2e0296
I20240502 20:46:11.618201 9546 log_verifier.cc:177] Verified matching terms for 180 ops in tablet d2a72d81232b487ea716903ddb2e0296
I20240502 20:46:11.618376 9546 log_verifier.cc:126] Checking tablet ed4d27cc41454a108252941a99cd16e2
I20240502 20:46:11.724354 9546 log_verifier.cc:177] Verified matching terms for 208 ops in tablet ed4d27cc41454a108252941a99cd16e2
I20240502 20:46:11.724551 9546 log_verifier.cc:126] Checking tablet f3be8e3350854d95922df01b9218a1d7
I20240502 20:46:11.853184 9546 log_verifier.cc:177] Verified matching terms for 264 ops in tablet f3be8e3350854d95922df01b9218a1d7
I20240502 20:46:11.854974 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 11487
I20240502 20:46:11.864444 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 11619
I20240502 20:46:11.872112 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 11750
W20240502 20:46:11.883061 12028 connection.cc:535] client connection to 127.9.82.131:42315 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240502 20:46:11.883180 12028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 2 similar messages]
I20240502 20:46:11.883437 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 11881
W20240502 20:46:11.886758 12161 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.129:36161: connect: Connection refused (error 111)
W20240502 20:46:11.887774 12161 consensus_peers.cc:485] T cb2ea660d9044aa7a565ab0c19601244 P 72cfad7451c64ef59a18e09d16a79046 -> Peer 5521e131639043f8b116f9c71cf4bfee (127.9.82.129:36161): Couldn't send request to peer 5521e131639043f8b116f9c71cf4bfee. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.129:36161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:46:11.891808 12028 consensus_peers.cc:485] T 067f71582a514a66a0b3fc4681a84471 P 7dd8e38181f24e349fb179d2a9eb74c1 -> Peer 07fe14e7347a4682bd8f6026ad776da3 (127.9.82.131:42315): Couldn't send request to peer 07fe14e7347a4682bd8f6026ad776da3. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.131:42315: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:11.892515 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 12012
I20240502 20:46:11.899940 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 12143
I20240502 20:46:11.907398 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 13080
I20240502 20:46:11.914356 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 14414
I20240502 20:46:11.920794 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 11395
2024-05-02T20:46:11Z chronyd exiting
[ OK ] RebalanceParamTest.Rebalance/7 (36714 ms)
[----------] 1 test from RebalanceParamTest (36714 ms total)
[----------] 1 test from TserverAddedDuringRebalancingTest
[ RUN ] TserverAddedDuringRebalancingTest.TserverStarts/1
I20240502 20:46:12.024222 9546 test_util.cc:268] Using random seed: -1316525161
I20240502 20:46:12.025044 9546 ts_itest-base.cc:112] Starting cluster with:
I20240502 20:46:12.025090 9546 ts_itest-base.cc:113] --------------
I20240502 20:46:12.025101 9546 ts_itest-base.cc:114] 8 tablet servers
I20240502 20:46:12.025111 9546 ts_itest-base.cc:115] 3 replicas per TS
I20240502 20:46:12.025122 9546 ts_itest-base.cc:116] --------------
2024-05-02T20:46:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T20:46:12Z Disabled control of system clock
I20240502 20:46:12.037128 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:39049
--webserver_interface=127.9.82.190
--webserver_port=0
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.82.190:39049
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false with env {}
W20240502 20:46:12.151010 15459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:12.151319 15459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:12.151393 15459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:12.154718 15459 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:12.154842 15459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 20:46:12.154886 15459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:12.154945 15459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 20:46:12.154989 15459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 20:46:12.158907 15459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.9.82.190:39049
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:39049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.9.82.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.15459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:12.159982 15459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:12.161160 15459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:12.169064 15467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:12.169446 15465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:12.170365 15464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:12.171208 15459 server_base.cc:1034] running on GCE node
I20240502 20:46:12.171775 15459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:12.172746 15459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:12.173938 15459 hybrid_clock.cc:648] HybridClock initialized: now 1714682772173905 us; error 48 us; skew 500 ppm
I20240502 20:46:12.176141 15459 webserver.cc:460] Webserver started at http://127.9.82.190:45449/ using document root <none> and password file <none>
I20240502 20:46:12.176803 15459 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:12.176872 15459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:12.177067 15459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:12.178828 15459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "8fe765eb5fa44c818352e1248973b04e"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.179329 15459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "8fe765eb5fa44c818352e1248973b04e"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.182925 15459 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20240502 20:46:12.185357 15473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.186414 15459 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:12.186568 15459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
uuid: "8fe765eb5fa44c818352e1248973b04e"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.186667 15459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:12.200276 15459 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:12.200960 15459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:12.201146 15459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:12.208088 15459 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.190:39049
I20240502 20:46:12.208101 15525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.190:39049 every 8 connection(s)
I20240502 20:46:12.209218 15459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 20:46:12.211977 15526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:12.213122 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 15459
I20240502 20:46:12.213259 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 20:46:12.218281 15526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e: Bootstrap starting.
I20240502 20:46:12.220880 15526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:12.221804 15526 log.cc:824] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:12.223506 15526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e: No bootstrap required, opened a new log
I20240502 20:46:12.226294 15526 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe765eb5fa44c818352e1248973b04e" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39049 } }
I20240502 20:46:12.226508 15526 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:12.226613 15526 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe765eb5fa44c818352e1248973b04e, State: Initialized, Role: FOLLOWER
I20240502 20:46:12.227026 15526 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe765eb5fa44c818352e1248973b04e" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39049 } }
I20240502 20:46:12.227145 15526 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:12.227191 15526 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:12.227269 15526 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:12.228106 15526 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe765eb5fa44c818352e1248973b04e" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39049 } }
I20240502 20:46:12.228415 15526 leader_election.cc:302] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fe765eb5fa44c818352e1248973b04e; no voters:
I20240502 20:46:12.228667 15526 leader_election.cc:288] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:12.228788 15531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:12.228993 15531 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [term 1 LEADER]: Becoming Leader. State: Replica: 8fe765eb5fa44c818352e1248973b04e, State: Running, Role: LEADER
I20240502 20:46:12.229343 15531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe765eb5fa44c818352e1248973b04e" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39049 } }
I20240502 20:46:12.229740 15526 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [sys.catalog]: configured and running, proceeding with master startup.
I20240502 20:46:12.230966 15533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe765eb5fa44c818352e1248973b04e. Latest consensus state: current_term: 1 leader_uuid: "8fe765eb5fa44c818352e1248973b04e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe765eb5fa44c818352e1248973b04e" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39049 } } }
I20240502 20:46:12.231101 15533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [sys.catalog]: This master's current role is: LEADER
I20240502 20:46:12.231429 15532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fe765eb5fa44c818352e1248973b04e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe765eb5fa44c818352e1248973b04e" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39049 } } }
I20240502 20:46:12.232054 15540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 20:46:12.232127 15532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e [sys.catalog]: This master's current role is: LEADER
I20240502 20:46:12.234781 15540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 20:46:12.240681 15540 catalog_manager.cc:1347] Generated new cluster ID: c645b3a703634f6a9968ba8e1381371a
I20240502 20:46:12.240777 15540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 20:46:12.280779 15540 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 20:46:12.281926 15540 catalog_manager.cc:1504] Loading token signing keys...
I20240502 20:46:12.295318 15540 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 8fe765eb5fa44c818352e1248973b04e: Generated new TSK 0
I20240502 20:46:12.296135 15540 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 20:46:12.308864 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.129:0
--local_ip_for_outbound_sockets=127.9.82.129
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39049
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
W20240502 20:46:12.428203 15550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:12.428469 15550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:12.428551 15550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:12.431825 15550 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:12.431919 15550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:12.432030 15550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.129
I20240502 20:46:12.435840 15550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.9.82.129
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.15550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.129
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:12.436866 15550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:12.438076 15550 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:12.447393 15555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:12.447921 15558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:12.448396 15556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:12.449468 15550 server_base.cc:1034] running on GCE node
I20240502 20:46:12.449929 15550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:12.450557 15550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:12.451784 15550 hybrid_clock.cc:648] HybridClock initialized: now 1714682772451752 us; error 44 us; skew 500 ppm
I20240502 20:46:12.453994 15550 webserver.cc:460] Webserver started at http://127.9.82.129:45283/ using document root <none> and password file <none>
I20240502 20:46:12.454594 15550 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:12.454655 15550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:12.454838 15550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:12.456650 15550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.457150 15550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.460757 15550 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 20:46:12.463061 15564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.464195 15550 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:46:12.464320 15550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.464426 15550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:12.479692 15550 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:12.480446 15550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:12.480625 15550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:12.481190 15550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:12.482105 15550 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:12.482157 15550 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.482216 15550 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:12.482250 15550 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.491190 15550 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.129:34245
I20240502 20:46:12.491217 15677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.129:34245 every 8 connection(s)
I20240502 20:46:12.492249 15550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 20:46:12.497045 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 15550
I20240502 20:46:12.497156 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 20:46:12.499302 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.130:0
--local_ip_for_outbound_sockets=127.9.82.130
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39049
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:12.501787 15678 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:12.502000 15678 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:12.502514 15678 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:12.503979 15490 ts_manager.cc:194] Registered new tserver with Master: 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:12.505118 15490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.129:51423
W20240502 20:46:12.617820 15681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:12.618089 15681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:12.618170 15681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:12.621485 15681 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:12.621583 15681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:12.621696 15681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.130
I20240502 20:46:12.625828 15681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.9.82.130
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.15681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.130
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:12.626946 15681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:12.628193 15681 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:12.638005 15687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:12.638751 15689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:12.639461 15686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:12.640136 15681 server_base.cc:1034] running on GCE node
I20240502 20:46:12.640588 15681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:12.641204 15681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:12.642369 15681 hybrid_clock.cc:648] HybridClock initialized: now 1714682772642350 us; error 35 us; skew 500 ppm
I20240502 20:46:12.644634 15681 webserver.cc:460] Webserver started at http://127.9.82.130:40351/ using document root <none> and password file <none>
I20240502 20:46:12.645226 15681 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:12.645291 15681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:12.645473 15681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:12.647289 15681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "0dfebe1fc59a48debca946314a5e3d0a"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.647817 15681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "0dfebe1fc59a48debca946314a5e3d0a"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.651232 15681 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:46:12.653549 15695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.654577 15681 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:12.654690 15681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "0dfebe1fc59a48debca946314a5e3d0a"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.654779 15681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:12.668743 15681 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:12.669643 15681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:12.669838 15681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:12.670439 15681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:12.671387 15681 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:12.671448 15681 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.671509 15681 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:12.671548 15681 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.680545 15681 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.130:32937
I20240502 20:46:12.680581 15808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.130:32937 every 8 connection(s)
I20240502 20:46:12.681522 15681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 20:46:12.688026 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 15681
I20240502 20:46:12.688180 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 20:46:12.690735 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.131:0
--local_ip_for_outbound_sockets=127.9.82.131
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39049
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:12.690847 15809 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:12.691092 15809 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:12.691704 15809 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:12.692812 15490 ts_manager.cc:194] Registered new tserver with Master: 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:12.693450 15490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.130:54133
W20240502 20:46:12.801841 15812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:12.802086 15812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:12.802136 15812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:12.805207 15812 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:12.805284 15812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:12.805361 15812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.131
I20240502 20:46:12.809034 15812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.9.82.131
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.15812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.131
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:12.810017 15812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:12.811127 15812 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:12.819752 15817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:12.820137 15820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:12.820812 15818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:12.821843 15812 server_base.cc:1034] running on GCE node
I20240502 20:46:12.822319 15812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:12.822916 15812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:12.824097 15812 hybrid_clock.cc:648] HybridClock initialized: now 1714682772824069 us; error 43 us; skew 500 ppm
I20240502 20:46:12.826318 15812 webserver.cc:460] Webserver started at http://127.9.82.131:38293/ using document root <none> and password file <none>
I20240502 20:46:12.826917 15812 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:12.826995 15812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:12.827180 15812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:12.828938 15812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "f7df976329f944319cef90e7116dfa96"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.829414 15812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "f7df976329f944319cef90e7116dfa96"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.832989 15812 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 20:46:12.835289 15826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.836421 15812 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:46:12.836537 15812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "f7df976329f944319cef90e7116dfa96"
format_stamp: "Formatted at 2024-05-02 20:46:12 on dist-test-slave-2pss"
I20240502 20:46:12.836640 15812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:12.879366 15812 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:12.880127 15812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:12.880297 15812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:12.880870 15812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:12.881794 15812 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:12.881845 15812 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.881903 15812 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:12.881937 15812 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:12.891618 15812 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.131:40885
I20240502 20:46:12.891660 15939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.131:40885 every 8 connection(s)
I20240502 20:46:12.892619 15812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 20:46:12.898265 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 15812
I20240502 20:46:12.898380 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 20:46:12.900841 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.132:0
--local_ip_for_outbound_sockets=127.9.82.132
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39049
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:12.902015 15940 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:12.902267 15940 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:12.902817 15940 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:12.903935 15490 ts_manager.cc:194] Registered new tserver with Master: f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:12.904728 15490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.131:59821
W20240502 20:46:13.018167 15943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:13.018393 15943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:13.018440 15943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:13.021787 15943 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:13.021868 15943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:13.021950 15943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.132
I20240502 20:46:13.025794 15943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.9.82.132
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.15943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.132
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:13.026794 15943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:13.027981 15943 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:13.037060 15949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:13.037335 15948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:13.038357 15951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:13.039242 15943 server_base.cc:1034] running on GCE node
I20240502 20:46:13.039753 15943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:13.040445 15943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:13.041621 15943 hybrid_clock.cc:648] HybridClock initialized: now 1714682773041592 us; error 46 us; skew 500 ppm
I20240502 20:46:13.043804 15943 webserver.cc:460] Webserver started at http://127.9.82.132:46813/ using document root <none> and password file <none>
I20240502 20:46:13.044389 15943 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:13.044451 15943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:13.044637 15943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:13.046394 15943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "3be8cce319d343fca3df1cf166a55a74"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.046885 15943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "3be8cce319d343fca3df1cf166a55a74"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.050369 15943 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20240502 20:46:13.052665 15957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.053731 15943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:46:13.053886 15943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "3be8cce319d343fca3df1cf166a55a74"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.053983 15943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:13.074630 15943 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:13.075354 15943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:13.075542 15943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:13.076166 15943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:13.077111 15943 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:13.077163 15943 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.077227 15943 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:13.077260 15943 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.086246 15943 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.132:33949
I20240502 20:46:13.086275 16070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.132:33949 every 8 connection(s)
I20240502 20:46:13.087253 15943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 20:46:13.088518 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 15943
I20240502 20:46:13.088657 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 20:46:13.091091 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.133:0
--local_ip_for_outbound_sockets=127.9.82.133
--webserver_interface=127.9.82.133
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39049
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:13.098140 16071 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:13.098410 16071 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:13.099011 16071 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:13.100214 15490 ts_manager.cc:194] Registered new tserver with Master: 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:13.101153 15490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.132:44743
W20240502 20:46:13.210918 16074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:13.211239 16074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:13.211319 16074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:13.215669 16074 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:13.215791 16074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:13.215905 16074 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.133
I20240502 20:46:13.221091 16074 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.9.82.133
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.16074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.133
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:13.222036 16074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:13.223156 16074 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:13.232035 16079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:13.232662 16082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:13.233340 16080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:13.234179 16074 server_base.cc:1034] running on GCE node
I20240502 20:46:13.234637 16074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:13.235229 16074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:13.236431 16074 hybrid_clock.cc:648] HybridClock initialized: now 1714682773236421 us; error 39 us; skew 500 ppm
I20240502 20:46:13.238602 16074 webserver.cc:460] Webserver started at http://127.9.82.133:44291/ using document root <none> and password file <none>
I20240502 20:46:13.239181 16074 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:13.239245 16074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:13.239425 16074 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:13.241344 16074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "049bb73c1cda4f3a95adddfc2a6ea66f"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.241848 16074 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "049bb73c1cda4f3a95adddfc2a6ea66f"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.245574 16074 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 20:46:13.247896 16088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.248972 16074 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:13.249096 16074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "049bb73c1cda4f3a95adddfc2a6ea66f"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.249198 16074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:13.279978 16074 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:13.280714 16074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:13.280898 16074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:13.281477 16074 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:13.282433 16074 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:13.282483 16074 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.282546 16074 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:13.282575 16074 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.291610 16074 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.133:44363
I20240502 20:46:13.291683 16201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.133:44363 every 8 connection(s)
I20240502 20:46:13.292675 16074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 20:46:13.299206 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 16074
I20240502 20:46:13.299347 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20240502 20:46:13.301731 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.134:0
--local_ip_for_outbound_sockets=127.9.82.134
--webserver_interface=127.9.82.134
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39049
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:13.301860 16202 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:13.302126 16202 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:13.302821 16202 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:13.303937 15490 ts_manager.cc:194] Registered new tserver with Master: 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363)
I20240502 20:46:13.304508 15490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.133:41019
W20240502 20:46:13.416340 16205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:13.416594 16205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:13.416682 16205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:13.419831 16205 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:13.419931 16205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:13.420034 16205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.134
I20240502 20:46:13.423838 16205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.134:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.9.82.134
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.16205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.134
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:13.424860 16205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:13.426008 16205 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:13.435204 16213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:13.435559 16211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:13.436549 16210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:13.437352 16205 server_base.cc:1034] running on GCE node
I20240502 20:46:13.437798 16205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:13.438436 16205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:13.439621 16205 hybrid_clock.cc:648] HybridClock initialized: now 1714682773439604 us; error 30 us; skew 500 ppm
I20240502 20:46:13.446753 16205 webserver.cc:460] Webserver started at http://127.9.82.134:32973/ using document root <none> and password file <none>
I20240502 20:46:13.447389 16205 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:13.447455 16205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:13.447645 16205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:13.449445 16205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "376b7736472c4bf2836c4303abf8e6c3"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.449995 16205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "376b7736472c4bf2836c4303abf8e6c3"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.453534 16205 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 20:46:13.455971 16219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.457082 16205 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:46:13.457206 16205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "376b7736472c4bf2836c4303abf8e6c3"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.457307 16205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:13.468885 16205 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:13.469594 16205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:13.469789 16205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:13.470537 16205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:13.471531 16205 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:13.471588 16205 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.471648 16205 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:13.471683 16205 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.480479 16205 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.134:35373
I20240502 20:46:13.480501 16332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.134:35373 every 8 connection(s)
I20240502 20:46:13.481495 16205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20240502 20:46:13.489256 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 16205
I20240502 20:46:13.489431 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20240502 20:46:13.490495 16333 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:13.490741 16333 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:13.491387 16333 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:13.491919 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.135:0
--local_ip_for_outbound_sockets=127.9.82.135
--webserver_interface=127.9.82.135
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39049
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:13.492494 15490 ts_manager.cc:194] Registered new tserver with Master: 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373)
I20240502 20:46:13.493212 15490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.134:54861
I20240502 20:46:13.507962 15678 heartbeater.cc:503] Master 127.9.82.190:39049 was elected leader, sending a full tablet report...
W20240502 20:46:13.605971 16336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:13.606223 16336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:13.606272 16336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:13.609490 16336 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:13.609575 16336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:13.609658 16336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.135
I20240502 20:46:13.613556 16336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.135:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.9.82.135
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.16336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.135
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:13.614567 16336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:13.615779 16336 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:13.625038 16341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:13.625547 16344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:13.626482 16342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:13.627379 16336 server_base.cc:1034] running on GCE node
I20240502 20:46:13.627888 16336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:13.628525 16336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:13.629689 16336 hybrid_clock.cc:648] HybridClock initialized: now 1714682773629665 us; error 48 us; skew 500 ppm
I20240502 20:46:13.631928 16336 webserver.cc:460] Webserver started at http://127.9.82.135:46491/ using document root <none> and password file <none>
I20240502 20:46:13.632511 16336 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:13.632577 16336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:13.632761 16336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:13.634541 16336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "47eb2a910e8949308b382a74c55030b5"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.635051 16336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "47eb2a910e8949308b382a74c55030b5"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.638689 16336 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20240502 20:46:13.641386 16350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.642488 16336 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:13.642604 16336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "47eb2a910e8949308b382a74c55030b5"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.642725 16336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:13.686501 16336 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:13.687121 16336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:13.687278 16336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:13.687857 16336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:13.688753 16336 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:13.688807 16336 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.688867 16336 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:13.688907 16336 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.695505 15809 heartbeater.cc:503] Master 127.9.82.190:39049 was elected leader, sending a full tablet report...
I20240502 20:46:13.697969 16336 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.135:34733
I20240502 20:46:13.698002 16463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.135:34733 every 8 connection(s)
I20240502 20:46:13.698925 16336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 20:46:13.699656 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 16336
I20240502 20:46:13.699790 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20240502 20:46:13.702060 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.136:0
--local_ip_for_outbound_sockets=127.9.82.136
--webserver_interface=127.9.82.136
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39049
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:13.709118 16464 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:13.709388 16464 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:13.709944 16464 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:13.711052 15490 ts_manager.cc:194] Registered new tserver with Master: 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733)
I20240502 20:46:13.711902 15490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.135:46551
W20240502 20:46:13.814682 16467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:13.814932 16467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:13.814980 16467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:13.818151 16467 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:13.818220 16467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:13.818300 16467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.136
I20240502 20:46:13.822252 16467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.136:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.9.82.136
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.16467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.136
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:13.823185 16467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:13.824378 16467 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:13.833102 16472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:13.833667 16475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:13.834617 16467 server_base.cc:1034] running on GCE node
W20240502 20:46:13.835309 16473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:13.835794 16467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:13.836426 16467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:13.837584 16467 hybrid_clock.cc:648] HybridClock initialized: now 1714682773837572 us; error 27 us; skew 500 ppm
I20240502 20:46:13.839773 16467 webserver.cc:460] Webserver started at http://127.9.82.136:45065/ using document root <none> and password file <none>
I20240502 20:46:13.840451 16467 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:13.840512 16467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:13.840694 16467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:13.842453 16467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "389fb867bde04f9980fe702dc1111079"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.842945 16467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "389fb867bde04f9980fe702dc1111079"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.846701 16467 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20240502 20:46:13.849092 16481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.850209 16467 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:13.850332 16467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "389fb867bde04f9980fe702dc1111079"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:13.850430 16467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:13.868902 16467 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:13.869622 16467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:13.869793 16467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:13.870370 16467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:13.871290 16467 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:13.871349 16467 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.871426 16467 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:13.871454 16467 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:13.880354 16467 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.136:41687
I20240502 20:46:13.880386 16594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.136:41687 every 8 connection(s)
I20240502 20:46:13.881384 16467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 20:46:13.889698 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 16467
I20240502 20:46:13.889822 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20240502 20:46:13.891662 16595 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:13.891927 16595 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:13.892522 16595 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:13.893508 15490 ts_manager.cc:194] Registered new tserver with Master: 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687)
I20240502 20:46:13.894062 15490 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.136:39173
I20240502 20:46:13.905225 9546 external_mini_cluster.cc:930] 8 TS(s) registered with all masters
I20240502 20:46:13.906903 15940 heartbeater.cc:503] Master 127.9.82.190:39049 was elected leader, sending a full tablet report...
I20240502 20:46:13.915349 9546 external_mini_cluster.cc:930] 8 TS(s) registered with all masters
I20240502 20:46:13.915441 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 16074
I20240502 20:46:13.921381 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 16205
I20240502 20:46:13.927407 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 16336
I20240502 20:46:13.933633 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 16467
I20240502 20:46:14.103315 16071 heartbeater.cc:503] Master 127.9.82.190:39049 was elected leader, sending a full tablet report...
I20240502 20:46:17.691165 15490 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:17.712042 15874 tablet_service.cc:1467] Processing CreateTablet for tablet 702e67697b514f7fb3975d56c253d918 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:17.712743 15612 tablet_service.cc:1467] Processing CreateTablet for tablet 702e67697b514f7fb3975d56c253d918 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:17.713111 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 702e67697b514f7fb3975d56c253d918. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:17.713407 15743 tablet_service.cc:1467] Processing CreateTablet for tablet 702e67697b514f7fb3975d56c253d918 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:17.713665 15612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 702e67697b514f7fb3975d56c253d918. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:17.714115 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 702e67697b514f7fb3975d56c253d918. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:17.716024 15611 tablet_service.cc:1467] Processing CreateTablet for tablet b5981b9676cb4abab938aeaf7fe52c3d (DEFAULT_TABLE table=rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:17.716305 15611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5981b9676cb4abab938aeaf7fe52c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:17.716934 15610 tablet_service.cc:1467] Processing CreateTablet for tablet 86ff3421109a484f869fd29f63392186 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:17.717165 15610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86ff3421109a484f869fd29f63392186. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:17.717792 15742 tablet_service.cc:1467] Processing CreateTablet for tablet b5981b9676cb4abab938aeaf7fe52c3d (DEFAULT_TABLE table=rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:17.718066 15742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5981b9676cb4abab938aeaf7fe52c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:17.718578 16005 tablet_service.cc:1467] Processing CreateTablet for tablet b5981b9676cb4abab938aeaf7fe52c3d (DEFAULT_TABLE table=rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:17.719462 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5981b9676cb4abab938aeaf7fe52c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:17.720029 15873 tablet_service.cc:1467] Processing CreateTablet for tablet 86ff3421109a484f869fd29f63392186 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:17.720321 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86ff3421109a484f869fd29f63392186. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:17.718578 16004 tablet_service.cc:1467] Processing CreateTablet for tablet 86ff3421109a484f869fd29f63392186 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:17.722826 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86ff3421109a484f869fd29f63392186. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:17.726056 16617 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:17.726532 16618 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:17.728809 16618 tablet_bootstrap.cc:654] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:17.728967 16617 tablet_bootstrap.cc:654] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:17.729624 16617 log.cc:824] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:17.729674 16618 log.cc:824] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:17.731400 16616 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:17.731513 16618 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:17.731532 16617 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:17.731704 16617 ts_tablet_manager.cc:1367] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 20:46:17.731706 16618 ts_tablet_manager.cc:1367] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20240502 20:46:17.733721 16616 tablet_bootstrap.cc:654] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:17.734321 16618 raft_consensus.cc:348] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.734540 16616 log.cc:824] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:17.734575 16618 raft_consensus.cc:374] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:17.734630 16618 raft_consensus.cc:729] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:17.735069 16618 consensus_queue.cc:260] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.735208 16615 tablet_bootstrap.cc:492] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:17.735579 16617 raft_consensus.cc:348] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.735885 16617 raft_consensus.cc:374] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:17.735958 16617 raft_consensus.cc:729] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:17.735985 16618 ts_tablet_manager.cc:1398] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240502 20:46:17.736243 16618 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:17.736411 16617 consensus_queue.cc:260] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.737154 16618 tablet_bootstrap.cc:654] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:17.737254 16617 ts_tablet_manager.cc:1398] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20240502 20:46:17.737517 16617 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:17.738492 16617 tablet_bootstrap.cc:654] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:17.738521 16618 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:17.738591 16618 ts_tablet_manager.cc:1367] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:17.739034 16618 raft_consensus.cc:348] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:17.739173 16618 raft_consensus.cc:374] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:17.739243 16618 raft_consensus.cc:729] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:17.739578 16618 consensus_queue.cc:260] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:17.739881 16617 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:17.740020 16618 ts_tablet_manager.cc:1398] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:17.740031 16617 ts_tablet_manager.cc:1367] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240502 20:46:17.740334 16618 tablet_bootstrap.cc:492] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:17.740577 16617 raft_consensus.cc:348] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:17.740857 16617 raft_consensus.cc:374] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:17.740957 16617 raft_consensus.cc:729] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:17.741174 16617 consensus_queue.cc:260] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:17.741312 16618 tablet_bootstrap.cc:654] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:17.741510 16617 ts_tablet_manager.cc:1398] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:17.742564 16618 tablet_bootstrap.cc:492] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:17.742720 16618 ts_tablet_manager.cc:1367] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:17.743294 16618 raft_consensus.cc:348] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.743451 16618 raft_consensus.cc:374] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:17.743501 16618 raft_consensus.cc:729] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:17.743638 16618 consensus_queue.cc:260] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.743958 16618 ts_tablet_manager.cc:1398] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:17.744925 16615 tablet_bootstrap.cc:654] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:17.745237 16616 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:17.745424 16616 ts_tablet_manager.cc:1367] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20240502 20:46:17.746598 16615 log.cc:824] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96: Log is configured to *not* fsync() on all Append() calls
W20240502 20:46:17.747089 15679 tablet.cc:2369] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:46:17.748324 16615 tablet_bootstrap.cc:492] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:17.748495 16615 ts_tablet_manager.cc:1367] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20240502 20:46:17.748579 16616 raft_consensus.cc:348] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.748955 16616 raft_consensus.cc:374] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:17.749023 16616 raft_consensus.cc:729] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:17.749451 16616 consensus_queue.cc:260] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.750257 16616 ts_tablet_manager.cc:1398] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 20:46:17.750509 16616 tablet_bootstrap.cc:492] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:17.751344 16616 tablet_bootstrap.cc:654] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:17.752415 16616 tablet_bootstrap.cc:492] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:17.752498 16616 ts_tablet_manager.cc:1367] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:17.752624 16615 raft_consensus.cc:348] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.752869 16615 raft_consensus.cc:374] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:17.752943 16615 raft_consensus.cc:729] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:17.753055 16616 raft_consensus.cc:348] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.753159 16616 raft_consensus.cc:374] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:17.753230 16616 raft_consensus.cc:729] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:17.753381 16616 consensus_queue.cc:260] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.753491 16615 consensus_queue.cc:260] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.753938 16616 ts_tablet_manager.cc:1398] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:17.754513 16615 ts_tablet_manager.cc:1398] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240502 20:46:17.754789 16615 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:17.755826 16615 tablet_bootstrap.cc:654] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:17.756829 16615 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:17.756916 16615 ts_tablet_manager.cc:1367] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 20:46:17.757441 16615 raft_consensus.cc:348] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:17.757534 16615 raft_consensus.cc:374] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:17.757567 16615 raft_consensus.cc:729] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:17.757696 16615 consensus_queue.cc:260] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:17.757923 16615 ts_tablet_manager.cc:1398] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:17.799594 16622 raft_consensus.cc:482] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:17.799818 16622 raft_consensus.cc:504] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.800963 16622 leader_election.cc:288] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:17.805219 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5981b9676cb4abab938aeaf7fe52c3d" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:17.805220 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5981b9676cb4abab938aeaf7fe52c3d" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:17.805510 15763 raft_consensus.cc:2454] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:17.805508 16025 raft_consensus.cc:2454] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:17.805928 15567 leader_election.cc:302] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:17.806188 16622 raft_consensus.cc:2781] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:17.806263 16622 raft_consensus.cc:482] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:17.806304 16622 raft_consensus.cc:3037] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:17.807201 16622 raft_consensus.cc:504] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.807593 16622 leader_election.cc:288] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:17.807951 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5981b9676cb4abab938aeaf7fe52c3d" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:17.807991 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5981b9676cb4abab938aeaf7fe52c3d" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:17.808066 16025 raft_consensus.cc:3037] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:17.808106 15763 raft_consensus.cc:3037] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:17.809008 16025 raft_consensus.cc:2454] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:17.809012 15763 raft_consensus.cc:2454] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:17.809314 15566 leader_election.cc:302] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:17.809486 16622 raft_consensus.cc:2781] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:17.809698 16622 raft_consensus.cc:686] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:17.809994 16622 consensus_queue.cc:237] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:17.813161 15490 catalog_manager.cc:5484] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:17.841152 16630 raft_consensus.cc:482] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:17.841358 16630 raft_consensus.cc:504] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
W20240502 20:46:17.842052 16072 tablet.cc:2369] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:46:17.842554 16630 leader_election.cc:288] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:17.846299 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ff3421109a484f869fd29f63392186" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:17.846383 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ff3421109a484f869fd29f63392186" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:17.846438 16025 raft_consensus.cc:2454] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:17.846616 15632 raft_consensus.cc:2454] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:17.846813 15829 leader_election.cc:302] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:17.847108 16630 raft_consensus.cc:2781] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:17.847184 16630 raft_consensus.cc:482] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:17.847216 16630 raft_consensus.cc:3037] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:17.848196 16630 raft_consensus.cc:504] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:17.848567 16630 leader_election.cc:288] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:17.848927 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ff3421109a484f869fd29f63392186" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:17.849033 16025 raft_consensus.cc:3037] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:17.849195 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ff3421109a484f869fd29f63392186" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:17.849310 15632 raft_consensus.cc:3037] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:17.849818 16025 raft_consensus.cc:2454] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:17.850124 15829 leader_election.cc:302] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:17.850250 15632 raft_consensus.cc:2454] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:17.850315 16630 raft_consensus.cc:2781] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:17.850559 16630 raft_consensus.cc:686] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Becoming Leader. State: Replica: f7df976329f944319cef90e7116dfa96, State: Running, Role: LEADER
I20240502 20:46:17.850931 16630 consensus_queue.cc:237] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:17.854105 15490 catalog_manager.cc:5484] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7df976329f944319cef90e7116dfa96 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:17.897473 15941 tablet.cc:2369] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 20:46:17.936730 15810 tablet.cc:2369] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:46:18.015345 16630 raft_consensus.cc:482] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:18.015504 16630 raft_consensus.cc:504] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.016088 16630 leader_election.cc:288] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:18.016759 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "702e67697b514f7fb3975d56c253d918" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:18.016911 15632 raft_consensus.cc:2454] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:18.017231 15830 leader_election.cc:302] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:18.017432 16630 raft_consensus.cc:2781] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:18.017483 16630 raft_consensus.cc:482] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:18.017529 16630 raft_consensus.cc:3037] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.018348 16630 raft_consensus.cc:504] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.018688 16630 leader_election.cc:288] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:18.019032 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "702e67697b514f7fb3975d56c253d918" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:18.019158 15632 raft_consensus.cc:3037] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.019886 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "702e67697b514f7fb3975d56c253d918" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:18.019943 15762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "702e67697b514f7fb3975d56c253d918" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:18.020052 15763 raft_consensus.cc:2454] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:18.020107 15632 raft_consensus.cc:2454] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:18.020435 15830 leader_election.cc:302] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:18.020687 16630 raft_consensus.cc:2781] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:18.020781 16630 raft_consensus.cc:686] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Becoming Leader. State: Replica: f7df976329f944319cef90e7116dfa96, State: Running, Role: LEADER
I20240502 20:46:18.020928 16630 consensus_queue.cc:237] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.022926 15490 catalog_manager.cc:5484] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7df976329f944319cef90e7116dfa96 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:18.182381 16641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:18.182631 16641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:18.185691 16641 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_0'
I20240502 20:46:18.230008 16622 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.236500 16634 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.277112 15763 raft_consensus.cc:3037] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.278256 15763 raft_consensus.cc:1261] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.279814 16630 consensus_queue.cc:1035] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.281738 16025 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.281807 15632 raft_consensus.cc:1261] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.282810 16638 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.281827 15631 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.286379 16630 consensus_queue.cc:1035] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.286734 16630 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.293442 16675 mvcc.cc:205] Tried to move back new op lower bound from 7023340659836755968 to 7023340658079916032. Current Snapshot: MvccSnapshot[applied={T|T < 7023340659816456192}]
I20240502 20:46:18.293678 16683 mvcc.cc:205] Tried to move back new op lower bound from 7023340659836755968 to 7023340658079916032. Current Snapshot: MvccSnapshot[applied={T|T < 7023340659816456192}]
I20240502 20:46:18.309698 16665 mvcc.cc:205] Tried to move back new op lower bound from 7023340659836833792 to 7023340658775220224. Current Snapshot: MvccSnapshot[applied={T|T < 7023340659797487616}]
I20240502 20:46:18.310213 16681 mvcc.cc:205] Tried to move back new op lower bound from 7023340659797487616 to 7023340658775220224. Current Snapshot: MvccSnapshot[applied={T|T < 7023340659797487616}]
INSERT report
rows total: 2000
time total: 114.86 ms
time per row: 0.0574299 ms
I20240502 20:46:18.344197 15489 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:18.349750 15743 tablet_service.cc:1467] Processing CreateTablet for tablet 167efd92157a42ec84ea1cfb1de4a15c (DEFAULT_TABLE table=rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.349839 15873 tablet_service.cc:1467] Processing CreateTablet for tablet 167efd92157a42ec84ea1cfb1de4a15c (DEFAULT_TABLE table=rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.350093 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167efd92157a42ec84ea1cfb1de4a15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.350095 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167efd92157a42ec84ea1cfb1de4a15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.350566 16004 tablet_service.cc:1467] Processing CreateTablet for tablet d61acdada50a42ba96d4844e64dba6a7 (DEFAULT_TABLE table=rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.350876 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61acdada50a42ba96d4844e64dba6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.351303 15612 tablet_service.cc:1467] Processing CreateTablet for tablet 60c7001f651848b788926cde86a3c0f6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.351574 15612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60c7001f651848b788926cde86a3c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.352782 16704 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:18.352779 16005 tablet_service.cc:1467] Processing CreateTablet for tablet 167efd92157a42ec84ea1cfb1de4a15c (DEFAULT_TABLE table=rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.353018 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167efd92157a42ec84ea1cfb1de4a15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.353694 16704 tablet_bootstrap.cc:654] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.354068 16706 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:18.354230 16705 tablet_bootstrap.cc:492] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:18.354799 16704 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:18.354899 16704 ts_tablet_manager.cc:1367] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:18.355020 16706 tablet_bootstrap.cc:654] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.355047 16705 tablet_bootstrap.cc:654] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.355355 16704 raft_consensus.cc:348] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.355476 16704 raft_consensus.cc:374] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.355513 16704 raft_consensus.cc:729] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.355648 16704 consensus_queue.cc:260] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.355881 16703 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:18.355969 16704 ts_tablet_manager.cc:1398] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:18.356174 15874 tablet_service.cc:1467] Processing CreateTablet for tablet 60c7001f651848b788926cde86a3c0f6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.356438 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60c7001f651848b788926cde86a3c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.356570 15742 tablet_service.cc:1467] Processing CreateTablet for tablet 60c7001f651848b788926cde86a3c0f6 (DEFAULT_TABLE table=rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.356818 15742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60c7001f651848b788926cde86a3c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.356978 15743 tablet_service.cc:1467] Processing CreateTablet for tablet d61acdada50a42ba96d4844e64dba6a7 (DEFAULT_TABLE table=rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.357203 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61acdada50a42ba96d4844e64dba6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.357262 15873 tablet_service.cc:1467] Processing CreateTablet for tablet d61acdada50a42ba96d4844e64dba6a7 (DEFAULT_TABLE table=rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.357478 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61acdada50a42ba96d4844e64dba6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.359156 16704 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:18.359534 16703 tablet_bootstrap.cc:654] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.360148 16704 tablet_bootstrap.cc:654] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.360916 16705 tablet_bootstrap.cc:492] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:18.360916 16706 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:18.361007 16706 ts_tablet_manager.cc:1367] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240502 20:46:18.361032 16705 ts_tablet_manager.cc:1367] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 20:46:18.361217 16704 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:18.361294 16704 ts_tablet_manager.cc:1367] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:18.361470 16703 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:18.361464 16705 raft_consensus.cc:348] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.361464 16706 raft_consensus.cc:348] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.361543 16703 ts_tablet_manager.cc:1367] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:46:18.361570 16706 raft_consensus.cc:374] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.361570 16705 raft_consensus.cc:374] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.361604 16706 raft_consensus.cc:729] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.361604 16705 raft_consensus.cc:729] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.361732 16706 consensus_queue.cc:260] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.361732 16705 consensus_queue.cc:260] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.361721 16704 raft_consensus.cc:348] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.361811 16704 raft_consensus.cc:374] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.361843 16704 raft_consensus.cc:729] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.361955 16704 consensus_queue.cc:260] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.361970 16703 raft_consensus.cc:348] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.362025 16705 ts_tablet_manager.cc:1398] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:18.362058 16703 raft_consensus.cc:374] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.362090 16703 raft_consensus.cc:729] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.362146 16706 ts_tablet_manager.cc:1398] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:18.362183 16705 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:18.362222 16704 ts_tablet_manager.cc:1398] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 20:46:18.362200 16703 consensus_queue.cc:260] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.362375 16704 tablet_bootstrap.cc:492] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:18.363096 16705 tablet_bootstrap.cc:654] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.363257 16704 tablet_bootstrap.cc:654] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.363519 16703 ts_tablet_manager.cc:1398] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:18.363793 16703 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:18.364727 16703 tablet_bootstrap.cc:654] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.365829 16705 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:18.365918 16705 ts_tablet_manager.cc:1367] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:18.366379 16704 tablet_bootstrap.cc:492] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:18.366405 16705 raft_consensus.cc:348] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.366518 16705 raft_consensus.cc:374] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.366557 16705 raft_consensus.cc:729] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.366663 16704 ts_tablet_manager.cc:1367] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:18.366693 16705 consensus_queue.cc:260] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.366747 16703 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:18.366827 16703 ts_tablet_manager.cc:1367] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:18.366986 16705 ts_tablet_manager.cc:1398] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:18.367173 16700 raft_consensus.cc:482] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:18.367239 16703 raft_consensus.cc:348] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.367257 16700 raft_consensus.cc:504] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.367403 16703 raft_consensus.cc:374] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.367467 16703 raft_consensus.cc:729] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.367605 16703 consensus_queue.cc:260] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.367826 16700 leader_election.cc:288] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:18.368185 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "167efd92157a42ec84ea1cfb1de4a15c" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:18.368304 16025 raft_consensus.cc:2454] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:18.368451 16703 ts_tablet_manager.cc:1398] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:18.368572 15829 leader_election.cc:302] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:18.367976 16704 raft_consensus.cc:348] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.368613 16703 tablet_bootstrap.cc:492] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:18.368650 16704 raft_consensus.cc:374] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.368682 16704 raft_consensus.cc:729] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.368728 16700 raft_consensus.cc:2781] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:18.368772 16700 raft_consensus.cc:482] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:18.368805 16700 raft_consensus.cc:3037] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.368813 16704 consensus_queue.cc:260] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.369118 16704 ts_tablet_manager.cc:1398] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:18.368156 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "167efd92157a42ec84ea1cfb1de4a15c" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:18.369410 15763 raft_consensus.cc:2454] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:18.369549 16703 tablet_bootstrap.cc:654] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.369820 16700 raft_consensus.cc:504] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.369971 16623 raft_consensus.cc:482] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:18.370069 16623 raft_consensus.cc:504] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.370172 16700 leader_election.cc:288] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Requested vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:18.370463 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "167efd92157a42ec84ea1cfb1de4a15c" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:18.370566 15763 raft_consensus.cc:3037] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.370568 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "167efd92157a42ec84ea1cfb1de4a15c" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:18.370666 16025 raft_consensus.cc:3037] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.371294 16623 leader_election.cc:288] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:18.371563 16025 raft_consensus.cc:2454] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:18.371567 15763 raft_consensus.cc:2454] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:18.371908 15828 leader_election.cc:302] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:18.372372 16700 raft_consensus.cc:2781] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:18.372459 16700 raft_consensus.cc:686] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Becoming Leader. State: Replica: f7df976329f944319cef90e7116dfa96, State: Running, Role: LEADER
I20240502 20:46:18.372588 16700 consensus_queue.cc:237] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.374127 15490 catalog_manager.cc:5484] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7df976329f944319cef90e7116dfa96 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:18.374487 16703 tablet_bootstrap.cc:492] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:18.374594 16703 ts_tablet_manager.cc:1367] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 20:46:18.374994 16703 raft_consensus.cc:348] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.375089 16703 raft_consensus.cc:374] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.375118 16703 raft_consensus.cc:729] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.375229 16703 consensus_queue.cc:260] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.375689 16703 ts_tablet_manager.cc:1398] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:18.377208 15894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61acdada50a42ba96d4844e64dba6a7" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:18.377411 15894 raft_consensus.cc:2454] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:18.377848 15960 leader_election.cc:302] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:18.378113 16623 raft_consensus.cc:2781] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:18.378181 16623 raft_consensus.cc:482] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:18.378229 16623 raft_consensus.cc:3037] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.378748 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61acdada50a42ba96d4844e64dba6a7" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:18.378880 15763 raft_consensus.cc:2454] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:18.379202 16623 raft_consensus.cc:504] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.379524 16623 leader_election.cc:288] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:18.379890 15894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61acdada50a42ba96d4844e64dba6a7" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:18.379988 15894 raft_consensus.cc:3037] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.379968 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d61acdada50a42ba96d4844e64dba6a7" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:18.380107 15763 raft_consensus.cc:3037] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.380751 15894 raft_consensus.cc:2454] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:18.380818 15763 raft_consensus.cc:2454] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:18.381037 15960 leader_election.cc:302] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:18.381222 16623 raft_consensus.cc:2781] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:18.381444 16623 raft_consensus.cc:686] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:18.381745 16623 consensus_queue.cc:237] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.384040 15489 catalog_manager.cc:5484] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:18.471858 16622 raft_consensus.cc:482] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:18.472040 16622 raft_consensus.cc:504] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.472585 16622 leader_election.cc:288] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:18.473206 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60c7001f651848b788926cde86a3c0f6" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:18.473359 15763 raft_consensus.cc:2454] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:18.473675 15566 leader_election.cc:302] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:18.473886 16622 raft_consensus.cc:2781] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:18.473940 16622 raft_consensus.cc:482] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:18.473991 16622 raft_consensus.cc:3037] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.475131 16622 raft_consensus.cc:504] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.475472 16622 leader_election.cc:288] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:18.475850 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60c7001f651848b788926cde86a3c0f6" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:18.476003 15763 raft_consensus.cc:3037] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.476892 15894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60c7001f651848b788926cde86a3c0f6" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:18.476933 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60c7001f651848b788926cde86a3c0f6" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:18.477085 15763 raft_consensus.cc:2454] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:18.477087 15894 raft_consensus.cc:2454] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:18.477403 15566 leader_election.cc:302] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:18.477567 16622 raft_consensus.cc:2781] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:18.477653 16622 raft_consensus.cc:686] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:18.477773 16622 consensus_queue.cc:237] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.479528 15489 catalog_manager.cc:5484] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:18.634471 16723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:18.634732 16723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:18.637802 16723 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_1'
I20240502 20:46:18.715850 15893 raft_consensus.cc:1261] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.716784 16623 consensus_queue.cc:1035] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.717145 15763 raft_consensus.cc:1261] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.717535 16623 consensus_queue.cc:1035] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.718159 16025 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.718611 16700 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.736194 15893 raft_consensus.cc:3037] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.737301 15893 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.737761 16677 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.738081 15762 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.738556 16677 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:18.744887 15763 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:18.748603 16700 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 109.462 ms
time per row: 0.0547312 ms
I20240502 20:46:18.792309 15483 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:18.797525 16005 tablet_service.cc:1467] Processing CreateTablet for tablet ef8149e90bfc405db47acd6d6fe576ad (DEFAULT_TABLE table=rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.797610 15612 tablet_service.cc:1467] Processing CreateTablet for tablet ef8149e90bfc405db47acd6d6fe576ad (DEFAULT_TABLE table=rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.797760 15743 tablet_service.cc:1467] Processing CreateTablet for tablet ef8149e90bfc405db47acd6d6fe576ad (DEFAULT_TABLE table=rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.797847 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8149e90bfc405db47acd6d6fe576ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.797899 15612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8149e90bfc405db47acd6d6fe576ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.798007 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8149e90bfc405db47acd6d6fe576ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.798518 15742 tablet_service.cc:1467] Processing CreateTablet for tablet 601b3ef7a0e34242a97210ff74c9e8b3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.798743 15742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601b3ef7a0e34242a97210ff74c9e8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.800029 16706 tablet_bootstrap.cc:492] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:18.800033 16704 tablet_bootstrap.cc:492] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:18.800086 16705 tablet_bootstrap.cc:492] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:18.800829 16706 tablet_bootstrap.cc:654] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.800829 16704 tablet_bootstrap.cc:654] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.800974 16705 tablet_bootstrap.cc:654] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.801860 15612 tablet_service.cc:1467] Processing CreateTablet for tablet 3e16f4c2f41e41eeb40b67b147296581 (DEFAULT_TABLE table=rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.802100 15612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e16f4c2f41e41eeb40b67b147296581. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.802058 16005 tablet_service.cc:1467] Processing CreateTablet for tablet 3e16f4c2f41e41eeb40b67b147296581 (DEFAULT_TABLE table=rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.802227 16706 tablet_bootstrap.cc:492] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:18.802266 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e16f4c2f41e41eeb40b67b147296581. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.802296 16706 ts_tablet_manager.cc:1367] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:18.802332 15873 tablet_service.cc:1467] Processing CreateTablet for tablet 3e16f4c2f41e41eeb40b67b147296581 (DEFAULT_TABLE table=rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.802578 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e16f4c2f41e41eeb40b67b147296581. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.802855 16706 raft_consensus.cc:348] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.802995 16706 raft_consensus.cc:374] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.803050 16706 raft_consensus.cc:729] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.803195 16706 consensus_queue.cc:260] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.803478 16706 ts_tablet_manager.cc:1398] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:18.804235 15611 tablet_service.cc:1467] Processing CreateTablet for tablet 601b3ef7a0e34242a97210ff74c9e8b3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.804481 15611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601b3ef7a0e34242a97210ff74c9e8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.804653 16703 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:18.805549 16703 tablet_bootstrap.cc:654] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.806282 16004 tablet_service.cc:1467] Processing CreateTablet for tablet 601b3ef7a0e34242a97210ff74c9e8b3 (DEFAULT_TABLE table=rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:18.806548 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601b3ef7a0e34242a97210ff74c9e8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:18.806604 16705 tablet_bootstrap.cc:492] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:18.806710 16705 ts_tablet_manager.cc:1367] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 20:46:18.806753 16703 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:18.806823 16703 ts_tablet_manager.cc:1367] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:18.807155 16705 raft_consensus.cc:348] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.807255 16705 raft_consensus.cc:374] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.807286 16705 raft_consensus.cc:729] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.807248 16703 raft_consensus.cc:348] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.807339 16703 raft_consensus.cc:374] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.807371 16703 raft_consensus.cc:729] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.807415 16705 consensus_queue.cc:260] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.807484 16703 consensus_queue.cc:260] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.807682 16705 ts_tablet_manager.cc:1398] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:18.807847 16705 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:18.807757 16703 ts_tablet_manager.cc:1398] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:18.808781 16705 tablet_bootstrap.cc:654] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.808848 16704 tablet_bootstrap.cc:492] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:18.808933 16704 ts_tablet_manager.cc:1367] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20240502 20:46:18.809425 16704 raft_consensus.cc:348] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.809538 16704 raft_consensus.cc:374] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.809572 16704 raft_consensus.cc:729] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.809697 16704 consensus_queue.cc:260] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.809900 16705 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:18.809971 16705 ts_tablet_manager.cc:1367] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:18.809971 16704 ts_tablet_manager.cc:1398] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:18.810112 16704 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:18.810380 16705 raft_consensus.cc:348] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.810465 16705 raft_consensus.cc:374] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.810494 16705 raft_consensus.cc:729] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.810988 16704 tablet_bootstrap.cc:654] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.811415 16705 consensus_queue.cc:260] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.811851 16706 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:18.811961 16705 ts_tablet_manager.cc:1398] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:18.812111 16705 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:18.812314 16704 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:18.812404 16704 ts_tablet_manager.cc:1367] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:18.812808 16704 raft_consensus.cc:348] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.812898 16704 raft_consensus.cc:374] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.812932 16704 raft_consensus.cc:729] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.813035 16704 consensus_queue.cc:260] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.813107 16706 tablet_bootstrap.cc:654] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.813184 16705 tablet_bootstrap.cc:654] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.813304 16704 ts_tablet_manager.cc:1398] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:18.814318 16706 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:18.814399 16706 ts_tablet_manager.cc:1367] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:18.814848 16706 raft_consensus.cc:348] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.814951 16706 raft_consensus.cc:374] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.814992 16706 raft_consensus.cc:729] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.815136 16706 consensus_queue.cc:260] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.815445 16706 ts_tablet_manager.cc:1398] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:18.815609 16706 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:18.815642 16705 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:18.815706 16705 ts_tablet_manager.cc:1367] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:18.816607 16706 tablet_bootstrap.cc:654] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:18.816841 16705 raft_consensus.cc:348] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.817013 16705 raft_consensus.cc:374] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.817072 16705 raft_consensus.cc:729] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.817696 16706 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:18.817785 16706 ts_tablet_manager.cc:1367] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:18.817786 16705 consensus_queue.cc:260] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.818113 16705 ts_tablet_manager.cc:1398] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:18.818199 16706 raft_consensus.cc:348] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.818305 16706 raft_consensus.cc:374] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:18.818348 16706 raft_consensus.cc:729] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:18.818496 16706 consensus_queue.cc:260] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:18.818797 16706 ts_tablet_manager.cc:1398] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:18.831599 16634 raft_consensus.cc:482] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:18.831768 16634 raft_consensus.cc:504] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.832222 16634 leader_election.cc:288] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:18.832612 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:18.832695 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:18.832772 16025 raft_consensus.cc:2454] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:18.832824 15893 raft_consensus.cc:2454] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:18.833110 15567 leader_election.cc:302] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:18.833272 16634 raft_consensus.cc:2781] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:18.833330 16634 raft_consensus.cc:482] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:18.833382 16634 raft_consensus.cc:3037] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.834147 16634 raft_consensus.cc:504] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.834445 16634 leader_election.cc:288] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:18.834815 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:18.834918 16025 raft_consensus.cc:3037] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.834923 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:18.835065 15893 raft_consensus.cc:3037] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.835672 16025 raft_consensus.cc:2454] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:18.835917 15893 raft_consensus.cc:2454] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:18.836016 15567 leader_election.cc:302] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:18.836181 16634 raft_consensus.cc:2781] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:18.836263 16634 raft_consensus.cc:686] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:18.836411 16634 consensus_queue.cc:237] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:18.838057 15489 catalog_manager.cc:5484] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:18.866478 16634 raft_consensus.cc:482] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:18.866603 16634 raft_consensus.cc:504] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.867014 16634 leader_election.cc:288] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:18.867451 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8149e90bfc405db47acd6d6fe576ad" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:18.867466 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8149e90bfc405db47acd6d6fe576ad" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:18.867594 16025 raft_consensus.cc:2454] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:18.867612 15763 raft_consensus.cc:2454] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:18.867915 15567 leader_election.cc:302] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:18.868162 16634 raft_consensus.cc:2781] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:18.868242 16634 raft_consensus.cc:482] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:18.868294 16634 raft_consensus.cc:3037] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.869110 16634 raft_consensus.cc:504] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.869457 16634 leader_election.cc:288] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:18.869788 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8149e90bfc405db47acd6d6fe576ad" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:18.869807 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef8149e90bfc405db47acd6d6fe576ad" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:18.869917 15763 raft_consensus.cc:3037] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.869917 16025 raft_consensus.cc:3037] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:18.870837 16025 raft_consensus.cc:2454] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:18.870837 15763 raft_consensus.cc:2454] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:18.871129 15566 leader_election.cc:302] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:18.871345 16634 raft_consensus.cc:2781] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:18.871417 16634 raft_consensus.cc:686] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:18.871592 16634 consensus_queue.cc:237] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:18.873148 15489 catalog_manager.cc:5484] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:19.035929 16623 raft_consensus.cc:482] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:19.036078 16623 raft_consensus.cc:504] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.036600 16623 leader_election.cc:288] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:19.037129 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601b3ef7a0e34242a97210ff74c9e8b3" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:19.037269 15763 raft_consensus.cc:2454] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:19.037580 15959 leader_election.cc:302] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:19.037744 16623 raft_consensus.cc:2781] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:19.037801 16623 raft_consensus.cc:482] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:19.037828 16623 raft_consensus.cc:3037] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.038666 16623 raft_consensus.cc:504] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.039039 16623 leader_election.cc:288] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:19.039340 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601b3ef7a0e34242a97210ff74c9e8b3" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:19.039464 15763 raft_consensus.cc:3037] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.040485 15763 raft_consensus.cc:2454] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:19.040695 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601b3ef7a0e34242a97210ff74c9e8b3" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:19.040812 15959 leader_election.cc:302] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:19.040849 15632 raft_consensus.cc:2454] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:19.040856 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601b3ef7a0e34242a97210ff74c9e8b3" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:19.041004 16623 raft_consensus.cc:2781] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:19.041047 15631 raft_consensus.cc:3037] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.041093 16623 raft_consensus.cc:686] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:19.041239 16623 consensus_queue.cc:237] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.041989 15631 raft_consensus.cc:2454] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:19.043411 15489 catalog_manager.cc:5484] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } }
W20240502 20:46:19.208087 16773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:19.208382 16773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:19.212934 16773 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_2'
I20240502 20:46:19.274055 16634 consensus_queue.cc:1035] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.278409 16634 consensus_queue.cc:1035] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.283249 16622 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.288779 16622 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.320129 15631 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:19.320820 16623 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.321534 15761 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:19.322069 16719 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 115.539 ms
time per row: 0.0577695 ms
I20240502 20:46:19.378870 15489 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:19.384902 15873 tablet_service.cc:1467] Processing CreateTablet for tablet a6521649137d4bab9ecf18c8f81abaed (DEFAULT_TABLE table=rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.384964 15611 tablet_service.cc:1467] Processing CreateTablet for tablet a6521649137d4bab9ecf18c8f81abaed (DEFAULT_TABLE table=rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.385243 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6521649137d4bab9ecf18c8f81abaed. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.385319 15611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6521649137d4bab9ecf18c8f81abaed. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.385814 15742 tablet_service.cc:1467] Processing CreateTablet for tablet a6521649137d4bab9ecf18c8f81abaed (DEFAULT_TABLE table=rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.386111 15742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6521649137d4bab9ecf18c8f81abaed. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.387195 16832 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:19.387658 16833 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:19.388267 16832 tablet_bootstrap.cc:654] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.388345 16834 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:19.388535 15743 tablet_service.cc:1467] Processing CreateTablet for tablet 68458e99b8b345428f95c3ef410545a3 (DEFAULT_TABLE table=rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.388674 16833 tablet_bootstrap.cc:654] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.388780 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68458e99b8b345428f95c3ef410545a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.389253 16834 tablet_bootstrap.cc:654] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.389783 16833 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:19.389878 16833 ts_tablet_manager.cc:1367] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 20:46:19.390373 16833 raft_consensus.cc:348] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.390492 16833 raft_consensus.cc:374] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.390535 16833 raft_consensus.cc:729] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.390704 16833 consensus_queue.cc:260] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.390728 16834 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:19.390818 16834 ts_tablet_manager.cc:1367] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:19.391033 16833 ts_tablet_manager.cc:1398] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:19.391269 16834 raft_consensus.cc:348] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.391396 16834 raft_consensus.cc:374] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.391440 16834 raft_consensus.cc:729] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.391584 16834 consensus_queue.cc:260] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.391996 15611 tablet_service.cc:1467] Processing CreateTablet for tablet effe8b25103e4fd6abafde8c7b425165 (DEFAULT_TABLE table=rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.392278 15611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effe8b25103e4fd6abafde8c7b425165. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.393163 16005 tablet_service.cc:1467] Processing CreateTablet for tablet 68458e99b8b345428f95c3ef410545a3 (DEFAULT_TABLE table=rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.393172 15873 tablet_service.cc:1467] Processing CreateTablet for tablet effe8b25103e4fd6abafde8c7b425165 (DEFAULT_TABLE table=rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.393426 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68458e99b8b345428f95c3ef410545a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.393435 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effe8b25103e4fd6abafde8c7b425165. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.394320 16833 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:19.394991 16834 ts_tablet_manager.cc:1398] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:46:19.395187 16834 tablet_bootstrap.cc:492] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:19.395671 15874 tablet_service.cc:1467] Processing CreateTablet for tablet 68458e99b8b345428f95c3ef410545a3 (DEFAULT_TABLE table=rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.395947 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68458e99b8b345428f95c3ef410545a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.396173 16834 tablet_bootstrap.cc:654] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.396284 16833 tablet_bootstrap.cc:654] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.396955 16838 tablet_bootstrap.cc:492] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:19.397464 16834 tablet_bootstrap.cc:492] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:19.397567 16834 ts_tablet_manager.cc:1367] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:19.397785 16838 tablet_bootstrap.cc:654] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.398015 16834 raft_consensus.cc:348] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.398140 16834 raft_consensus.cc:374] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.398183 16834 raft_consensus.cc:729] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.398159 16004 tablet_service.cc:1467] Processing CreateTablet for tablet effe8b25103e4fd6abafde8c7b425165 (DEFAULT_TABLE table=rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.398293 16834 consensus_queue.cc:260] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.398424 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effe8b25103e4fd6abafde8c7b425165. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.398658 16834 ts_tablet_manager.cc:1398] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:19.398869 16838 tablet_bootstrap.cc:492] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:19.398955 16838 ts_tablet_manager.cc:1367] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:19.399327 16838 raft_consensus.cc:348] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.399423 16838 raft_consensus.cc:374] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.399458 16838 raft_consensus.cc:729] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.399571 16838 consensus_queue.cc:260] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.400386 16838 ts_tablet_manager.cc:1398] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:19.400571 16838 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:19.401491 16838 tablet_bootstrap.cc:654] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.402319 16833 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:19.402423 16833 ts_tablet_manager.cc:1367] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20240502 20:46:19.402520 16832 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:19.402607 16832 ts_tablet_manager.cc:1367] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20240502 20:46:19.402928 16833 raft_consensus.cc:348] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:19.403012 16833 raft_consensus.cc:374] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.403033 16833 raft_consensus.cc:729] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.402977 16832 raft_consensus.cc:348] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.403111 16832 raft_consensus.cc:374] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.403138 16838 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:19.403147 16832 raft_consensus.cc:729] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.403146 16833 consensus_queue.cc:260] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:19.403210 16838 ts_tablet_manager.cc:1367] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:19.403280 16832 consensus_queue.cc:260] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.403399 16833 ts_tablet_manager.cc:1398] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:19.403544 16832 ts_tablet_manager.cc:1398] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:19.403707 16832 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:19.405192 16832 tablet_bootstrap.cc:654] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.406258 16832 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:19.406353 16832 ts_tablet_manager.cc:1367] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240502 20:46:19.406550 16838 raft_consensus.cc:348] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:19.406674 16838 raft_consensus.cc:374] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.406711 16838 raft_consensus.cc:729] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.406857 16838 consensus_queue.cc:260] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:19.406869 16832 raft_consensus.cc:348] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:19.406951 16832 raft_consensus.cc:374] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.406985 16832 raft_consensus.cc:729] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.407140 16832 consensus_queue.cc:260] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:19.407438 16832 ts_tablet_manager.cc:1398] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:19.407531 16838 ts_tablet_manager.cc:1398] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:46:19.407652 16832 tablet_bootstrap.cc:492] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:19.408553 16832 tablet_bootstrap.cc:654] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.409495 16832 tablet_bootstrap.cc:492] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:19.409574 16832 ts_tablet_manager.cc:1367] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:19.409952 16832 raft_consensus.cc:348] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.410058 16832 raft_consensus.cc:374] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.410109 16832 raft_consensus.cc:729] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.410233 16832 consensus_queue.cc:260] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.410460 16832 ts_tablet_manager.cc:1398] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:19.417510 16831 raft_consensus.cc:482] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:19.417634 16831 raft_consensus.cc:504] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.418043 16831 leader_election.cc:288] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:19.418401 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68458e99b8b345428f95c3ef410545a3" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:19.418514 15893 raft_consensus.cc:2454] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:19.418483 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68458e99b8b345428f95c3ef410545a3" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:19.418630 15761 raft_consensus.cc:2454] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:19.418850 15960 leader_election.cc:302] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:19.419027 16831 raft_consensus.cc:2781] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:19.419081 16831 raft_consensus.cc:482] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:19.419108 16831 raft_consensus.cc:3037] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.420154 16831 raft_consensus.cc:504] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.420557 16831 leader_election.cc:288] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:19.420873 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68458e99b8b345428f95c3ef410545a3" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:19.420871 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68458e99b8b345428f95c3ef410545a3" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:19.420974 15893 raft_consensus.cc:3037] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.421022 15761 raft_consensus.cc:3037] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.422101 15761 raft_consensus.cc:2454] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:19.422112 15893 raft_consensus.cc:2454] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:19.422430 15959 leader_election.cc:302] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:19.422596 16831 raft_consensus.cc:2781] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:19.422681 16831 raft_consensus.cc:686] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:19.422839 16831 consensus_queue.cc:237] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.424538 15488 catalog_manager.cc:5484] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:19.467890 16820 raft_consensus.cc:482] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:19.468022 16820 raft_consensus.cc:504] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.468448 16820 leader_election.cc:288] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:19.468890 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:19.468892 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:19.469024 15761 raft_consensus.cc:2454] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:19.469063 15893 raft_consensus.cc:2454] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:19.469347 15566 leader_election.cc:302] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:19.469569 16820 raft_consensus.cc:2781] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:19.469628 16820 raft_consensus.cc:482] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:19.469663 16820 raft_consensus.cc:3037] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.470489 16820 raft_consensus.cc:504] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.470814 16820 leader_election.cc:288] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:19.471148 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:19.471190 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:19.471264 15893 raft_consensus.cc:3037] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.471290 15761 raft_consensus.cc:3037] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.472065 15761 raft_consensus.cc:2454] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:19.472134 15893 raft_consensus.cc:2454] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:19.472342 15566 leader_election.cc:302] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:19.472498 16820 raft_consensus.cc:2781] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:19.472602 16820 raft_consensus.cc:686] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:19.472760 16820 consensus_queue.cc:237] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:19.474610 15488 catalog_manager.cc:5484] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:19.508471 16820 raft_consensus.cc:482] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:19.508639 16820 raft_consensus.cc:504] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:19.509066 16820 leader_election.cc:288] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:19.509553 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effe8b25103e4fd6abafde8c7b425165" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:19.509649 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effe8b25103e4fd6abafde8c7b425165" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:19.509718 15893 raft_consensus.cc:2454] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:19.509771 16025 raft_consensus.cc:2454] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:19.510066 15567 leader_election.cc:302] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:19.510372 16820 raft_consensus.cc:2781] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:19.510432 16820 raft_consensus.cc:482] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:19.510471 16820 raft_consensus.cc:3037] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.511355 16820 raft_consensus.cc:504] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:19.511701 16820 leader_election.cc:288] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:19.512089 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effe8b25103e4fd6abafde8c7b425165" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:19.512099 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effe8b25103e4fd6abafde8c7b425165" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:19.512220 16025 raft_consensus.cc:3037] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.512220 15893 raft_consensus.cc:3037] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.513162 16025 raft_consensus.cc:2454] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:19.513162 15893 raft_consensus.cc:2454] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:19.513471 15567 leader_election.cc:302] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:19.513623 16820 raft_consensus.cc:2781] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:19.513716 16820 raft_consensus.cc:686] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:19.513864 16820 consensus_queue.cc:237] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:19.515810 15488 catalog_manager.cc:5484] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } }
W20240502 20:46:19.636003 16848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:19.636257 16848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:19.639302 16848 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_3'
I20240502 20:46:19.712836 16025 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:19.712847 15893 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:19.713318 16819 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.713471 16820 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.714373 15761 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:19.714917 16816 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.715934 15894 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:19.717463 16816 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.724960 15761 raft_consensus.cc:1261] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:19.725643 15894 raft_consensus.cc:1261] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:19.727164 16831 consensus_queue.cc:1035] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:19.728539 16831 consensus_queue.cc:1035] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 117.182 ms
time per row: 0.0585908 ms
I20240502 20:46:19.802467 15489 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:19.808125 15743 tablet_service.cc:1467] Processing CreateTablet for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc (DEFAULT_TABLE table=rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.808148 15611 tablet_service.cc:1467] Processing CreateTablet for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc (DEFAULT_TABLE table=rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.808472 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.808480 15611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.808790 15610 tablet_service.cc:1467] Processing CreateTablet for tablet ce9c2a00fa6b43938a7eb89a82bae6ce (DEFAULT_TABLE table=rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.809031 15610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce9c2a00fa6b43938a7eb89a82bae6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.810201 16833 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:19.810350 15612 tablet_service.cc:1467] Processing CreateTablet for tablet 8a392f6644c1465cada45ddddf4ee2c5 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.810556 15612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a392f6644c1465cada45ddddf4ee2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.811048 16834 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:19.811060 16833 tablet_bootstrap.cc:654] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.812319 16834 tablet_bootstrap.cc:654] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.813573 16834 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:19.813664 16834 ts_tablet_manager.cc:1367] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:46:19.813874 15874 tablet_service.cc:1467] Processing CreateTablet for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc (DEFAULT_TABLE table=rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.814137 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.814131 16834 raft_consensus.cc:348] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.814230 16834 raft_consensus.cc:374] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.814261 16834 raft_consensus.cc:729] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.814395 16834 consensus_queue.cc:260] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.814697 16834 ts_tablet_manager.cc:1398] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:19.816016 16832 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:19.816109 15873 tablet_service.cc:1467] Processing CreateTablet for tablet ce9c2a00fa6b43938a7eb89a82bae6ce (DEFAULT_TABLE table=rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.816381 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce9c2a00fa6b43938a7eb89a82bae6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.816694 16832 tablet_bootstrap.cc:654] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.817530 16832 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:19.817615 16832 ts_tablet_manager.cc:1367] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:19.818176 16832 raft_consensus.cc:348] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.818269 16832 raft_consensus.cc:374] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.818303 16832 raft_consensus.cc:729] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.818428 16832 consensus_queue.cc:260] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.818702 16832 ts_tablet_manager.cc:1398] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 20:46:19.818890 16832 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:19.819099 16004 tablet_service.cc:1467] Processing CreateTablet for tablet 8a392f6644c1465cada45ddddf4ee2c5 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.819391 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a392f6644c1465cada45ddddf4ee2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.819751 16832 tablet_bootstrap.cc:654] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.821004 16832 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:19.821084 16832 ts_tablet_manager.cc:1367] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:46:19.821240 15743 tablet_service.cc:1467] Processing CreateTablet for tablet 8a392f6644c1465cada45ddddf4ee2c5 (DEFAULT_TABLE table=rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.821511 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a392f6644c1465cada45ddddf4ee2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.821486 16832 raft_consensus.cc:348] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.819099 16005 tablet_service.cc:1467] Processing CreateTablet for tablet ce9c2a00fa6b43938a7eb89a82bae6ce (DEFAULT_TABLE table=rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:19.821575 16832 raft_consensus.cc:374] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.821606 16832 raft_consensus.cc:729] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.821732 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce9c2a00fa6b43938a7eb89a82bae6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:19.821749 16838 tablet_bootstrap.cc:492] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:19.821720 16832 consensus_queue.cc:260] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.822047 16832 ts_tablet_manager.cc:1398] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:19.822490 16838 tablet_bootstrap.cc:654] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.823969 16838 tablet_bootstrap.cc:492] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:19.824056 16838 ts_tablet_manager.cc:1367] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:19.824481 16838 raft_consensus.cc:348] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.824592 16838 raft_consensus.cc:374] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.824617 16834 tablet_bootstrap.cc:492] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:19.824626 16838 raft_consensus.cc:729] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.824743 16838 consensus_queue.cc:260] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.824991 16838 ts_tablet_manager.cc:1398] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:19.825160 16838 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:19.825379 16833 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:19.825520 16833 ts_tablet_manager.cc:1367] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20240502 20:46:19.825579 16834 tablet_bootstrap.cc:654] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.826042 16838 tablet_bootstrap.cc:654] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.825987 16833 raft_consensus.cc:348] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.826120 16833 raft_consensus.cc:374] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.826157 16833 raft_consensus.cc:729] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.826290 16833 consensus_queue.cc:260] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.826610 16833 ts_tablet_manager.cc:1398] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:19.826784 16833 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:19.827754 16833 tablet_bootstrap.cc:654] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.829465 16834 tablet_bootstrap.cc:492] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:19.829567 16834 ts_tablet_manager.cc:1367] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240502 20:46:19.830085 16834 raft_consensus.cc:348] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.830204 16834 raft_consensus.cc:374] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.830260 16834 raft_consensus.cc:729] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.830404 16834 consensus_queue.cc:260] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.831184 16834 ts_tablet_manager.cc:1398] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:46:19.832031 16838 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:19.832131 16838 ts_tablet_manager.cc:1367] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20240502 20:46:19.832731 16838 raft_consensus.cc:348] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.832844 16838 raft_consensus.cc:374] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.832885 16838 raft_consensus.cc:729] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.833043 16838 consensus_queue.cc:260] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.833472 16838 ts_tablet_manager.cc:1398] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:19.837854 16623 raft_consensus.cc:482] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:19.837970 16623 raft_consensus.cc:504] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.838418 16623 leader_election.cc:288] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:19.838752 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a392f6644c1465cada45ddddf4ee2c5" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:19.839115 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a392f6644c1465cada45ddddf4ee2c5" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:19.839267 15761 raft_consensus.cc:2454] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
W20240502 20:46:19.839421 15961 leader_election.cc:341] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:46:19.839573 15959 leader_election.cc:302] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters: 8c5f48d02a284d0eb4b1fa3868ab669f
I20240502 20:46:19.839928 16623 raft_consensus.cc:2781] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:19.839990 16623 raft_consensus.cc:482] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:19.840029 16623 raft_consensus.cc:3037] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.840992 16623 raft_consensus.cc:504] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.841305 16623 leader_election.cc:288] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:19.841655 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a392f6644c1465cada45ddddf4ee2c5" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:19.841643 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a392f6644c1465cada45ddddf4ee2c5" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:19.841765 15761 raft_consensus.cc:3037] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
W20240502 20:46:19.841995 15961 leader_election.cc:341] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:46:19.842622 15761 raft_consensus.cc:2454] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:19.842882 15959 leader_election.cc:302] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters: 8c5f48d02a284d0eb4b1fa3868ab669f
I20240502 20:46:19.843068 16623 raft_consensus.cc:2781] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:19.843186 16623 raft_consensus.cc:686] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:19.843349 16623 consensus_queue.cc:237] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.845602 15489 catalog_manager.cc:5484] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:19.846624 16833 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:19.846714 16833 ts_tablet_manager.cc:1367] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20240502 20:46:19.847153 16833 raft_consensus.cc:348] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.847249 16833 raft_consensus.cc:374] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.847283 16833 raft_consensus.cc:729] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.847420 16833 consensus_queue.cc:260] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.847849 16833 ts_tablet_manager.cc:1398] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:19.848047 16833 tablet_bootstrap.cc:492] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:19.849027 16833 tablet_bootstrap.cc:654] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:19.849969 16833 tablet_bootstrap.cc:492] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:19.850057 16833 ts_tablet_manager.cc:1367] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:19.850445 16833 raft_consensus.cc:348] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.850551 16833 raft_consensus.cc:374] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:19.850582 16833 raft_consensus.cc:729] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:19.850695 16833 consensus_queue.cc:260] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.850910 16833 ts_tablet_manager.cc:1398] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:19.856747 16815 raft_consensus.cc:482] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:19.856839 16815 raft_consensus.cc:504] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.857225 16815 leader_election.cc:288] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:19.857622 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eb03dc9cdf04f7a9ef9b96da66ab7dc" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:19.857609 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eb03dc9cdf04f7a9ef9b96da66ab7dc" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:19.857774 15761 raft_consensus.cc:2454] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:19.857772 15893 raft_consensus.cc:2454] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:19.858036 15566 leader_election.cc:302] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:19.858211 16815 raft_consensus.cc:2781] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:19.858271 16815 raft_consensus.cc:482] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:19.858318 16815 raft_consensus.cc:3037] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.859205 16815 raft_consensus.cc:504] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.859498 16815 leader_election.cc:288] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:19.859846 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eb03dc9cdf04f7a9ef9b96da66ab7dc" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:19.859959 15893 raft_consensus.cc:3037] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.860710 15893 raft_consensus.cc:2454] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:19.860934 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1eb03dc9cdf04f7a9ef9b96da66ab7dc" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:19.861035 15567 leader_election.cc:302] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:19.861073 15761 raft_consensus.cc:3037] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.861196 16815 raft_consensus.cc:2781] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:19.861284 16815 raft_consensus.cc:686] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:19.861410 16815 consensus_queue.cc:237] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:19.862017 15761 raft_consensus.cc:2454] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:19.863286 15488 catalog_manager.cc:5484] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:19.973680 16815 raft_consensus.cc:482] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:19.973820 16815 raft_consensus.cc:504] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:19.974306 16815 leader_election.cc:288] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:19.974860 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a392f6644c1465cada45ddddf4ee2c5" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:19.974920 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a392f6644c1465cada45ddddf4ee2c5" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:19.975281 15761 raft_consensus.cc:2379] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c5f48d02a284d0eb4b1fa3868ab669f in current term 1: Already voted for candidate 3be8cce319d343fca3df1cf166a55a74 in this term.
I20240502 20:46:19.975752 15566 leader_election.cc:302] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c5f48d02a284d0eb4b1fa3868ab669f; no voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74
I20240502 20:46:19.975996 16815 raft_consensus.cc:3037] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:19.976824 16815 raft_consensus.cc:2726] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 20:46:20.170423 16678 raft_consensus.cc:482] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:20.170569 16678 raft_consensus.cc:504] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.171056 16678 leader_election.cc:288] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:20.171485 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce9c2a00fa6b43938a7eb89a82bae6ce" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:20.171527 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce9c2a00fa6b43938a7eb89a82bae6ce" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:20.171635 16025 raft_consensus.cc:2454] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:20.171669 15631 raft_consensus.cc:2454] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:20.171962 15829 leader_election.cc:302] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:20.172165 16678 raft_consensus.cc:2781] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:20.172223 16678 raft_consensus.cc:482] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:20.172251 16678 raft_consensus.cc:3037] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.173084 16678 raft_consensus.cc:504] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.173378 16678 leader_election.cc:288] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Requested vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:20.173707 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce9c2a00fa6b43938a7eb89a82bae6ce" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:20.173751 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce9c2a00fa6b43938a7eb89a82bae6ce" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:20.173803 16025 raft_consensus.cc:3037] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.173874 15631 raft_consensus.cc:3037] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.174525 16025 raft_consensus.cc:2454] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:20.174669 15631 raft_consensus.cc:2454] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:20.174784 15829 leader_election.cc:302] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:20.174957 16678 raft_consensus.cc:2781] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:20.175145 16678 raft_consensus.cc:686] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Becoming Leader. State: Replica: f7df976329f944319cef90e7116dfa96, State: Running, Role: LEADER
I20240502 20:46:20.175276 16678 consensus_queue.cc:237] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.176797 15488 catalog_manager.cc:5484] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7df976329f944319cef90e7116dfa96 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } }
W20240502 20:46:20.299516 16894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:20.299820 16894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:20.302963 16894 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_4'
I20240502 20:46:20.347780 16815 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:20.351613 16815 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:20.403117 15631 raft_consensus.cc:1261] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:20.403486 15761 raft_consensus.cc:1261] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:20.403489 16623 consensus_queue.cc:1035] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:20.405068 16623 consensus_queue.cc:1035] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:20.406899 15632 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:20.407514 16025 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:20.407958 16678 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:20.410009 16678 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 119.368 ms
time per row: 0.059684 ms
I20240502 20:46:20.467922 15490 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:20.473441 15743 tablet_service.cc:1467] Processing CreateTablet for tablet 1694de56984a4ca78f9dabaaca2677de (DEFAULT_TABLE table=rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:20.473616 15873 tablet_service.cc:1467] Processing CreateTablet for tablet 1694de56984a4ca78f9dabaaca2677de (DEFAULT_TABLE table=rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:20.473807 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1694de56984a4ca78f9dabaaca2677de. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:20.473924 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1694de56984a4ca78f9dabaaca2677de. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:20.474036 16005 tablet_service.cc:1467] Processing CreateTablet for tablet 1694de56984a4ca78f9dabaaca2677de (DEFAULT_TABLE table=rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:20.474310 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1694de56984a4ca78f9dabaaca2677de. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:20.474442 15742 tablet_service.cc:1467] Processing CreateTablet for tablet 89f653589b534402b873b05f9c15bf24 (DEFAULT_TABLE table=rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:20.474663 15742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f653589b534402b873b05f9c15bf24. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:20.476022 16004 tablet_service.cc:1467] Processing CreateTablet for tablet 89f653589b534402b873b05f9c15bf24 (DEFAULT_TABLE table=rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:20.476246 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f653589b534402b873b05f9c15bf24. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:20.476310 15612 tablet_service.cc:1467] Processing CreateTablet for tablet 1abc3674e948410296824189a95ae253 (DEFAULT_TABLE table=rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:20.476395 15741 tablet_service.cc:1467] Processing CreateTablet for tablet 1abc3674e948410296824189a95ae253 (DEFAULT_TABLE table=rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:20.476573 15612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1abc3674e948410296824189a95ae253. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:20.476733 15741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1abc3674e948410296824189a95ae253. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:20.477613 16960 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:20.478700 16959 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:20.479130 15873 tablet_service.cc:1467] Processing CreateTablet for tablet 89f653589b534402b873b05f9c15bf24 (DEFAULT_TABLE table=rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:20.479230 16960 tablet_bootstrap.cc:654] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:20.479360 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f653589b534402b873b05f9c15bf24. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:20.479548 16959 tablet_bootstrap.cc:654] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:20.479890 16962 tablet_bootstrap.cc:492] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:20.480299 16960 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:20.480381 16960 ts_tablet_manager.cc:1367] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:20.480501 15874 tablet_service.cc:1467] Processing CreateTablet for tablet 1abc3674e948410296824189a95ae253 (DEFAULT_TABLE table=rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:20.480675 16959 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:20.480741 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1abc3674e948410296824189a95ae253. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:20.480747 16959 ts_tablet_manager.cc:1367] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:20.480870 16960 raft_consensus.cc:348] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:20.480967 16960 raft_consensus.cc:374] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:20.480996 16960 raft_consensus.cc:729] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:20.481117 16960 consensus_queue.cc:260] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:20.481189 16959 raft_consensus.cc:348] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:20.481289 16959 raft_consensus.cc:374] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:20.481323 16959 raft_consensus.cc:729] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:20.481412 16960 ts_tablet_manager.cc:1398] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:20.481436 16959 consensus_queue.cc:260] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:20.481585 16960 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:20.481714 16959 ts_tablet_manager.cc:1398] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:20.481868 16959 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:20.482518 16960 tablet_bootstrap.cc:654] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:20.483086 16959 tablet_bootstrap.cc:654] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:20.484511 16961 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:20.484771 16962 tablet_bootstrap.cc:654] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:20.485049 16960 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:20.485137 16960 ts_tablet_manager.cc:1367] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:20.485380 16959 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:20.485457 16959 ts_tablet_manager.cc:1367] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:20.485605 16960 raft_consensus.cc:348] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.485713 16960 raft_consensus.cc:374] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:20.485742 16960 raft_consensus.cc:729] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:20.485852 16960 consensus_queue.cc:260] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.485909 16959 raft_consensus.cc:348] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.486025 16959 raft_consensus.cc:374] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:20.486063 16959 raft_consensus.cc:729] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:20.486099 16960 ts_tablet_manager.cc:1398] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:20.486235 16960 tablet_bootstrap.cc:492] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:20.487017 16961 tablet_bootstrap.cc:654] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:20.487074 16960 tablet_bootstrap.cc:654] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:20.486641 16959 consensus_queue.cc:260] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.488286 16962 tablet_bootstrap.cc:492] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:20.488292 16959 ts_tablet_manager.cc:1398] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:46:20.488404 16960 tablet_bootstrap.cc:492] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:20.488458 16959 tablet_bootstrap.cc:492] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:20.488494 16960 ts_tablet_manager.cc:1367] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:20.488888 16960 raft_consensus.cc:348] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:20.488982 16960 raft_consensus.cc:374] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:20.488992 16961 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:20.489012 16960 raft_consensus.cc:729] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:20.489099 16961 ts_tablet_manager.cc:1367] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:46:20.489137 16960 consensus_queue.cc:260] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:20.489341 16962 ts_tablet_manager.cc:1367] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20240502 20:46:20.489377 16959 tablet_bootstrap.cc:654] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:20.489437 16960 ts_tablet_manager.cc:1398] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:20.489609 16961 raft_consensus.cc:348] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.489715 16961 raft_consensus.cc:374] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:20.489751 16961 raft_consensus.cc:729] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:20.489877 16961 consensus_queue.cc:260] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.490155 16961 ts_tablet_manager.cc:1398] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:20.490314 16961 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:20.490635 16962 raft_consensus.cc:348] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:20.490765 16962 raft_consensus.cc:374] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:20.490795 16962 raft_consensus.cc:729] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:20.490949 16962 consensus_queue.cc:260] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:20.491195 16961 tablet_bootstrap.cc:654] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:20.491346 16959 tablet_bootstrap.cc:492] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:20.491422 16959 ts_tablet_manager.cc:1367] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:20.491475 16962 ts_tablet_manager.cc:1398] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:20.491880 16959 raft_consensus.cc:348] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:20.491987 16959 raft_consensus.cc:374] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:20.492008 16959 raft_consensus.cc:729] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:20.492110 16959 consensus_queue.cc:260] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:20.492354 16959 ts_tablet_manager.cc:1398] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:20.494252 16961 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:20.494366 16961 ts_tablet_manager.cc:1367] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:20.494745 16961 raft_consensus.cc:348] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:20.494829 16961 raft_consensus.cc:374] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:20.494850 16961 raft_consensus.cc:729] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:20.494987 16961 consensus_queue.cc:260] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:20.495196 16961 ts_tablet_manager.cc:1398] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:20.561518 16949 raft_consensus.cc:482] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:20.561652 16949 raft_consensus.cc:504] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:20.562194 16949 leader_election.cc:288] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:20.562557 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1694de56984a4ca78f9dabaaca2677de" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:20.562649 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1694de56984a4ca78f9dabaaca2677de" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:20.562698 15893 raft_consensus.cc:2454] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:20.562804 15761 raft_consensus.cc:2454] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:20.563019 15960 leader_election.cc:302] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:20.563192 16949 raft_consensus.cc:2781] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:20.563257 16949 raft_consensus.cc:482] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:20.563302 16949 raft_consensus.cc:3037] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.564157 16949 raft_consensus.cc:504] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:20.564455 16949 leader_election.cc:288] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:20.564764 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1694de56984a4ca78f9dabaaca2677de" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:20.564764 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1694de56984a4ca78f9dabaaca2677de" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:20.564864 15893 raft_consensus.cc:3037] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.564874 15761 raft_consensus.cc:3037] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.565593 15893 raft_consensus.cc:2454] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:20.565672 15761 raft_consensus.cc:2454] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:20.565871 15960 leader_election.cc:302] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:20.566094 16949 raft_consensus.cc:2781] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:20.566196 16949 raft_consensus.cc:686] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:20.566344 16949 consensus_queue.cc:237] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:20.568269 15490 catalog_manager.cc:5484] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:20.656219 16954 raft_consensus.cc:482] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:20.656358 16954 raft_consensus.cc:504] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.656859 16954 leader_election.cc:288] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:20.657337 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f653589b534402b873b05f9c15bf24" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:20.657341 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f653589b534402b873b05f9c15bf24" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:20.657481 16025 raft_consensus.cc:2454] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:20.657500 15761 raft_consensus.cc:2454] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:20.657773 15828 leader_election.cc:302] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:20.657953 16954 raft_consensus.cc:2781] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:20.658020 16954 raft_consensus.cc:482] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:20.658061 16954 raft_consensus.cc:3037] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.659415 16954 raft_consensus.cc:504] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.659771 16954 leader_election.cc:288] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Requested vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:20.660182 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f653589b534402b873b05f9c15bf24" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:20.660182 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f653589b534402b873b05f9c15bf24" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:20.660315 16025 raft_consensus.cc:3037] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.660315 15761 raft_consensus.cc:3037] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.661289 16025 raft_consensus.cc:2454] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:20.661289 15761 raft_consensus.cc:2454] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:20.661604 15828 leader_election.cc:302] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:20.661752 16954 raft_consensus.cc:2781] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:20.661845 16954 raft_consensus.cc:686] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Becoming Leader. State: Replica: f7df976329f944319cef90e7116dfa96, State: Running, Role: LEADER
I20240502 20:46:20.662007 16954 consensus_queue.cc:237] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:20.663971 15490 catalog_manager.cc:5484] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7df976329f944319cef90e7116dfa96 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:20.845777 16917 raft_consensus.cc:482] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:20.845912 16917 raft_consensus.cc:504] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:20.847000 16917 leader_election.cc:288] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:20.851438 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1abc3674e948410296824189a95ae253" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:20.851603 15631 raft_consensus.cc:2454] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:20.851603 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1abc3674e948410296824189a95ae253" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:20.851768 15893 raft_consensus.cc:2454] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:20.851995 15699 leader_election.cc:302] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:20.852246 16917 raft_consensus.cc:2781] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:20.852308 16917 raft_consensus.cc:482] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:20.852352 16917 raft_consensus.cc:3037] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.853199 16917 raft_consensus.cc:504] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:20.853509 16917 leader_election.cc:288] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Requested vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:20.853834 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1abc3674e948410296824189a95ae253" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:20.853842 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1abc3674e948410296824189a95ae253" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:20.853931 15893 raft_consensus.cc:3037] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.853993 15631 raft_consensus.cc:3037] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:20.854816 15631 raft_consensus.cc:2454] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 1.
I20240502 20:46:20.855118 15699 leader_election.cc:302] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:20.855288 16917 raft_consensus.cc:2781] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:20.855504 16917 raft_consensus.cc:686] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Becoming Leader. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Running, Role: LEADER
I20240502 20:46:20.855837 16917 consensus_queue.cc:237] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:20.858188 15490 catalog_manager.cc:5484] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130). New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:20.872593 15893 raft_consensus.cc:2454] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 1.
I20240502 20:46:21.004765 16623 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.008841 16949 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 20:46:21.053047 16978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:21.053314 16978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:21.056360 16978 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_5'
I20240502 20:46:21.102764 16954 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.118666 16892 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.157734 15631 raft_consensus.cc:1261] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:21.158761 16917 consensus_queue.cc:1035] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.164528 15894 raft_consensus.cc:1261] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:21.165858 16917 consensus_queue.cc:1035] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 133.654 ms
time per row: 0.066827 ms
I20240502 20:46:21.233070 15481 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:21.238766 16005 tablet_service.cc:1467] Processing CreateTablet for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4 (DEFAULT_TABLE table=rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.239115 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.239333 16004 tablet_service.cc:1467] Processing CreateTablet for tablet 15214db73de54afba83b983bc2865948 (DEFAULT_TABLE table=rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.239567 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15214db73de54afba83b983bc2865948. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.239562 15612 tablet_service.cc:1467] Processing CreateTablet for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4 (DEFAULT_TABLE table=rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.239895 15612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.240345 15610 tablet_service.cc:1467] Processing CreateTablet for tablet 15214db73de54afba83b983bc2865948 (DEFAULT_TABLE table=rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.240561 15610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15214db73de54afba83b983bc2865948. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.241370 15742 tablet_service.cc:1467] Processing CreateTablet for tablet 2436658a9dd54854a8920f9242068ee7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.241510 15874 tablet_service.cc:1467] Processing CreateTablet for tablet 15214db73de54afba83b983bc2865948 (DEFAULT_TABLE table=rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.241664 15742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2436658a9dd54854a8920f9242068ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.241818 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15214db73de54afba83b983bc2865948. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.241881 15611 tablet_service.cc:1467] Processing CreateTablet for tablet 2436658a9dd54854a8920f9242068ee7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.242121 15611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2436658a9dd54854a8920f9242068ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.241380 15741 tablet_service.cc:1467] Processing CreateTablet for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4 (DEFAULT_TABLE table=rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.243655 15741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.243834 17034 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:21.243469 17035 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:21.244627 17034 tablet_bootstrap.cc:654] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.244774 16005 tablet_service.cc:1467] Processing CreateTablet for tablet 2436658a9dd54854a8920f9242068ee7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.244999 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2436658a9dd54854a8920f9242068ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.245554 17035 tablet_bootstrap.cc:654] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.246233 17036 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:21.246745 17035 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:21.246845 17035 ts_tablet_manager.cc:1367] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:21.247148 17036 tablet_bootstrap.cc:654] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.247336 17035 raft_consensus.cc:348] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.247455 17035 raft_consensus.cc:374] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.247494 17035 raft_consensus.cc:729] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.247627 17035 consensus_queue.cc:260] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.247865 17034 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:21.247910 17035 ts_tablet_manager.cc:1398] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:21.248041 17034 ts_tablet_manager.cc:1367] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:21.248061 17035 tablet_bootstrap.cc:492] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:21.248401 17036 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:21.248512 17036 ts_tablet_manager.cc:1367] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:21.248649 17034 raft_consensus.cc:348] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:21.249207 17035 tablet_bootstrap.cc:654] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.249157 17036 raft_consensus.cc:348] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:21.249259 17036 raft_consensus.cc:374] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.249292 17036 raft_consensus.cc:729] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.249416 17036 consensus_queue.cc:260] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:21.249717 17036 ts_tablet_manager.cc:1398] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:46:21.248831 17034 raft_consensus.cc:374] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.249986 17034 raft_consensus.cc:729] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.250185 17034 consensus_queue.cc:260] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:21.250310 17035 tablet_bootstrap.cc:492] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:21.250385 17035 ts_tablet_manager.cc:1367] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 20:46:21.250813 17035 raft_consensus.cc:348] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.250931 17035 raft_consensus.cc:374] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.250964 17035 raft_consensus.cc:729] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.251111 17035 consensus_queue.cc:260] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.251296 17034 ts_tablet_manager.cc:1398] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:46:21.251353 17035 ts_tablet_manager.cc:1398] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:21.251448 17034 tablet_bootstrap.cc:492] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:21.253101 17034 tablet_bootstrap.cc:654] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.254081 17034 tablet_bootstrap.cc:492] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:21.254166 17034 ts_tablet_manager.cc:1367] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:21.254503 17034 raft_consensus.cc:348] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.254585 17034 raft_consensus.cc:374] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.254606 17034 raft_consensus.cc:729] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.254729 17034 consensus_queue.cc:260] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.255015 17034 ts_tablet_manager.cc:1398] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:21.255185 17034 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:21.256095 17034 tablet_bootstrap.cc:654] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.257670 17034 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:21.257761 17034 ts_tablet_manager.cc:1367] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:21.258502 17034 raft_consensus.cc:348] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.258594 17034 raft_consensus.cc:374] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.258652 17034 raft_consensus.cc:729] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.258932 17034 consensus_queue.cc:260] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.259182 17034 ts_tablet_manager.cc:1398] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:21.262285 17043 tablet_bootstrap.cc:492] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:21.263198 17043 tablet_bootstrap.cc:654] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.264335 17043 tablet_bootstrap.cc:492] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:21.264405 17043 ts_tablet_manager.cc:1367] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:21.264696 17043 raft_consensus.cc:348] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.264777 17043 raft_consensus.cc:374] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.264798 17043 raft_consensus.cc:729] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.264891 17043 consensus_queue.cc:260] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.265115 17043 ts_tablet_manager.cc:1398] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:21.265259 17043 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:21.265954 17043 tablet_bootstrap.cc:654] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.266947 17043 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:21.267022 17043 ts_tablet_manager.cc:1367] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:46:21.267365 17043 raft_consensus.cc:348] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:21.267447 17043 raft_consensus.cc:374] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.267467 17043 raft_consensus.cc:729] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.267577 17043 consensus_queue.cc:260] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:21.267895 17043 ts_tablet_manager.cc:1398] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:21.268066 17043 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:21.268815 17043 tablet_bootstrap.cc:654] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.269735 17043 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:21.269800 17043 ts_tablet_manager.cc:1367] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:21.270103 17043 raft_consensus.cc:348] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.270177 17043 raft_consensus.cc:374] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.270200 17043 raft_consensus.cc:729] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.270305 17043 consensus_queue.cc:260] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.270522 17043 ts_tablet_manager.cc:1398] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:21.272578 17013 raft_consensus.cc:482] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:21.272670 17013 raft_consensus.cc:504] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:21.273085 17013 leader_election.cc:288] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:21.273444 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15214db73de54afba83b983bc2865948" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:21.273445 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15214db73de54afba83b983bc2865948" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:21.273571 15631 raft_consensus.cc:2454] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:21.273571 15893 raft_consensus.cc:2454] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:21.273826 15960 leader_election.cc:302] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:21.274013 17013 raft_consensus.cc:2781] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:21.274068 17013 raft_consensus.cc:482] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:21.274098 17013 raft_consensus.cc:3037] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:21.274940 17013 raft_consensus.cc:504] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:21.275259 17013 leader_election.cc:288] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:21.275521 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15214db73de54afba83b983bc2865948" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:21.275578 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15214db73de54afba83b983bc2865948" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:21.275627 15631 raft_consensus.cc:3037] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:21.275698 15893 raft_consensus.cc:3037] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:21.276706 15631 raft_consensus.cc:2454] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:21.276787 15893 raft_consensus.cc:2454] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:21.277073 15960 leader_election.cc:302] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:21.277235 17013 raft_consensus.cc:2781] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:21.277321 17013 raft_consensus.cc:686] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:21.277457 17013 consensus_queue.cc:237] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:21.279006 15489 catalog_manager.cc:5484] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:21.452507 17013 raft_consensus.cc:482] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:21.452636 17013 raft_consensus.cc:504] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.453011 17013 leader_election.cc:288] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:21.453383 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2436658a9dd54854a8920f9242068ee7" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:21.453387 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2436658a9dd54854a8920f9242068ee7" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:21.453518 15761 raft_consensus.cc:2454] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:21.453541 15631 raft_consensus.cc:2454] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:21.453820 15959 leader_election.cc:302] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:21.454010 17013 raft_consensus.cc:2781] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:21.454066 17013 raft_consensus.cc:482] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:21.454118 17013 raft_consensus.cc:3037] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:21.454955 17013 raft_consensus.cc:504] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.455273 17013 leader_election.cc:288] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:21.455623 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2436658a9dd54854a8920f9242068ee7" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:21.455610 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2436658a9dd54854a8920f9242068ee7" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:21.455753 15631 raft_consensus.cc:3037] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:21.455763 15761 raft_consensus.cc:3037] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:21.456516 15631 raft_consensus.cc:2454] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:21.456552 15761 raft_consensus.cc:2454] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:21.456804 15961 leader_election.cc:302] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:21.457018 17013 raft_consensus.cc:2781] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:21.457105 17013 raft_consensus.cc:686] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:21.457273 17013 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.459103 15489 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:21.553000 17029 raft_consensus.cc:482] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:21.553153 17029 raft_consensus.cc:504] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.553695 17029 leader_election.cc:288] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:21.554315 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c0e045d15114b8ea88ff5ef05f3c1e4" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:21.554504 15631 raft_consensus.cc:2454] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:21.554812 15699 leader_election.cc:302] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:21.554997 17029 raft_consensus.cc:2781] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:21.555081 17029 raft_consensus.cc:482] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:21.555142 17029 raft_consensus.cc:3037] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:21.556106 17029 raft_consensus.cc:504] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.556485 17029 leader_election.cc:288] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Requested vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:21.556851 15631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c0e045d15114b8ea88ff5ef05f3c1e4" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:21.556977 15631 raft_consensus.cc:3037] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:21.557803 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c0e045d15114b8ea88ff5ef05f3c1e4" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:21.557951 16024 raft_consensus.cc:2454] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:21.558180 15631 raft_consensus.cc:2454] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 1.
I20240502 20:46:21.558192 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c0e045d15114b8ea88ff5ef05f3c1e4" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:21.558291 16025 raft_consensus.cc:3037] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:21.558480 15699 leader_election.cc:302] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:21.558636 17029 raft_consensus.cc:2781] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:21.558710 17029 raft_consensus.cc:686] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Becoming Leader. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Running, Role: LEADER
I20240502 20:46:21.558843 17029 consensus_queue.cc:237] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.559211 16025 raft_consensus.cc:2454] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 1.
I20240502 20:46:21.560561 15489 catalog_manager.cc:5484] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130). New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } }
W20240502 20:46:21.720288 17051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:21.720546 17051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:21.723609 17051 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_6'
I20240502 20:46:21.802227 17013 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.803797 15632 raft_consensus.cc:1261] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:21.804507 15761 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:21.804729 17029 consensus_queue.cc:1035] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.804926 17013 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.806110 15630 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:21.808302 16623 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.808940 16025 raft_consensus.cc:1261] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:21.809448 17029 consensus_queue.cc:1035] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.812258 15893 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:21.812866 16623 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:21.824820 17082 mvcc.cc:205] Tried to move back new op lower bound from 7023340674296352768 to 7023340672113905664. Current Snapshot: MvccSnapshot[applied={T|T < 7023340674296352768}]
INSERT report
rows total: 2000
time total: 111.645 ms
time per row: 0.0558223 ms
I20240502 20:46:21.879004 15488 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:21.885308 15741 tablet_service.cc:1467] Processing CreateTablet for tablet 8a46ac0be3ab49e185c300eeedb8cd39 (DEFAULT_TABLE table=rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.885353 16005 tablet_service.cc:1467] Processing CreateTablet for tablet a87847912eaa4602abf9bd9cf2c698fd (DEFAULT_TABLE table=rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.885654 15741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a46ac0be3ab49e185c300eeedb8cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.885684 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87847912eaa4602abf9bd9cf2c698fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.885684 15874 tablet_service.cc:1467] Processing CreateTablet for tablet 8a46ac0be3ab49e185c300eeedb8cd39 (DEFAULT_TABLE table=rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.885726 16004 tablet_service.cc:1467] Processing CreateTablet for tablet f015e46a8a27436dbd88b97dd1798cb0 (DEFAULT_TABLE table=rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.885931 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a46ac0be3ab49e185c300eeedb8cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.886147 15873 tablet_service.cc:1467] Processing CreateTablet for tablet a87847912eaa4602abf9bd9cf2c698fd (DEFAULT_TABLE table=rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.886368 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87847912eaa4602abf9bd9cf2c698fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.889130 15611 tablet_service.cc:1467] Processing CreateTablet for tablet 8a46ac0be3ab49e185c300eeedb8cd39 (DEFAULT_TABLE table=rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.889185 15741 tablet_service.cc:1467] Processing CreateTablet for tablet f015e46a8a27436dbd88b97dd1798cb0 (DEFAULT_TABLE table=rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.889420 15611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a46ac0be3ab49e185c300eeedb8cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.889425 15873 tablet_service.cc:1467] Processing CreateTablet for tablet f015e46a8a27436dbd88b97dd1798cb0 (DEFAULT_TABLE table=rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.889555 15741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f015e46a8a27436dbd88b97dd1798cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.889644 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f015e46a8a27436dbd88b97dd1798cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.891520 17114 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:21.891664 15610 tablet_service.cc:1467] Processing CreateTablet for tablet a87847912eaa4602abf9bd9cf2c698fd (DEFAULT_TABLE table=rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:21.891956 15610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87847912eaa4602abf9bd9cf2c698fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.892596 17114 tablet_bootstrap.cc:654] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.893684 17114 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:21.893772 17114 ts_tablet_manager.cc:1367] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:21.893842 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f015e46a8a27436dbd88b97dd1798cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:21.894157 17114 raft_consensus.cc:348] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.894243 17114 raft_consensus.cc:374] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.894263 17114 raft_consensus.cc:729] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.894371 17114 consensus_queue.cc:260] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.894615 17114 ts_tablet_manager.cc:1398] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:21.895685 17114 tablet_bootstrap.cc:492] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:21.896492 17115 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:21.896695 17114 tablet_bootstrap.cc:654] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.897337 17115 tablet_bootstrap.cc:654] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.897619 17114 tablet_bootstrap.cc:492] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:21.897696 17114 ts_tablet_manager.cc:1367] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:21.898015 17113 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:21.898144 17114 raft_consensus.cc:348] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.898238 17114 raft_consensus.cc:374] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.898298 17114 raft_consensus.cc:729] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.898435 17114 consensus_queue.cc:260] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.898721 17114 ts_tablet_manager.cc:1398] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:21.898798 17113 tablet_bootstrap.cc:654] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.899717 17115 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:21.899827 17115 ts_tablet_manager.cc:1367] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:21.899950 17113 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:21.900041 17113 ts_tablet_manager.cc:1367] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:21.900275 17115 raft_consensus.cc:348] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.900385 17115 raft_consensus.cc:374] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.900416 17115 raft_consensus.cc:729] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.900449 17113 raft_consensus.cc:348] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.900568 17113 raft_consensus.cc:374] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.900607 17113 raft_consensus.cc:729] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.900579 17115 consensus_queue.cc:260] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.900763 17113 consensus_queue.cc:260] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.901032 17113 ts_tablet_manager.cc:1398] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:21.901229 17113 tablet_bootstrap.cc:492] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:21.901492 17115 ts_tablet_manager.cc:1398] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:21.901669 17115 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:21.902117 17113 tablet_bootstrap.cc:654] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.902555 17115 tablet_bootstrap.cc:654] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.903282 17112 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:21.904166 17112 tablet_bootstrap.cc:654] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.904398 17113 tablet_bootstrap.cc:492] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:21.904479 17113 ts_tablet_manager.cc:1367] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:21.904917 17113 raft_consensus.cc:348] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.905014 17113 raft_consensus.cc:374] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.905054 17113 raft_consensus.cc:729] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.905094 17115 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:21.905172 17115 ts_tablet_manager.cc:1367] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:21.905174 17113 consensus_queue.cc:260] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.905443 17113 ts_tablet_manager.cc:1398] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:21.905776 17115 raft_consensus.cc:348] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.905891 17115 raft_consensus.cc:374] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.905939 17115 raft_consensus.cc:729] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.906085 17115 consensus_queue.cc:260] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.906391 17115 ts_tablet_manager.cc:1398] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:21.906855 17112 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:21.906944 17112 ts_tablet_manager.cc:1367] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:21.908051 17112 raft_consensus.cc:348] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.908167 17112 raft_consensus.cc:374] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.908208 17112 raft_consensus.cc:729] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.908329 17112 consensus_queue.cc:260] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:21.908578 17112 ts_tablet_manager.cc:1398] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:21.908720 17112 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:21.909559 17112 tablet_bootstrap.cc:654] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.910754 17112 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:21.910843 17112 ts_tablet_manager.cc:1367] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:21.911227 17112 raft_consensus.cc:348] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.911324 17112 raft_consensus.cc:374] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.911350 17112 raft_consensus.cc:729] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.911454 17112 consensus_queue.cc:260] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.911674 17112 ts_tablet_manager.cc:1398] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:21.911854 17112 tablet_bootstrap.cc:492] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:21.913125 17112 tablet_bootstrap.cc:654] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:21.914268 17112 tablet_bootstrap.cc:492] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:21.914345 17112 ts_tablet_manager.cc:1367] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:46:21.914721 17112 raft_consensus.cc:348] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.914811 17112 raft_consensus.cc:374] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:21.914950 17112 raft_consensus.cc:729] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:21.915073 17112 consensus_queue.cc:260] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:21.915385 17112 ts_tablet_manager.cc:1398] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:22.026394 16917 raft_consensus.cc:482] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:22.026533 16917 raft_consensus.cc:504] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:22.026902 16917 leader_election.cc:288] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:22.027382 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f015e46a8a27436dbd88b97dd1798cb0" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:22.027426 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f015e46a8a27436dbd88b97dd1798cb0" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:22.027551 15893 raft_consensus.cc:2454] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:22.027552 16025 raft_consensus.cc:2454] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:22.027880 15698 leader_election.cc:302] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:22.028044 16917 raft_consensus.cc:2781] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:22.028108 16917 raft_consensus.cc:482] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:22.028134 16917 raft_consensus.cc:3037] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.029053 16917 raft_consensus.cc:504] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:22.029392 16917 leader_election.cc:288] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Requested vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:22.029748 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f015e46a8a27436dbd88b97dd1798cb0" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:22.029865 16025 raft_consensus.cc:3037] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.029945 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f015e46a8a27436dbd88b97dd1798cb0" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:22.030062 15893 raft_consensus.cc:3037] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.030716 16025 raft_consensus.cc:2454] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 1.
I20240502 20:46:22.030938 15893 raft_consensus.cc:2454] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 1.
I20240502 20:46:22.030964 15698 leader_election.cc:302] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:22.031112 16917 raft_consensus.cc:2781] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:22.031208 16917 raft_consensus.cc:686] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Becoming Leader. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Running, Role: LEADER
I20240502 20:46:22.031365 16917 consensus_queue.cc:237] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:22.033269 15482 catalog_manager.cc:5484] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130). New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:22.062669 17033 raft_consensus.cc:482] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:22.062815 17033 raft_consensus.cc:504] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:22.063277 17033 leader_election.cc:288] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:22.063805 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87847912eaa4602abf9bd9cf2c698fd" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:22.063810 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87847912eaa4602abf9bd9cf2c698fd" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:22.063969 16025 raft_consensus.cc:2454] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:22.063969 15632 raft_consensus.cc:2454] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 0.
I20240502 20:46:22.064340 15829 leader_election.cc:302] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:22.064523 17033 raft_consensus.cc:2781] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:22.064594 17033 raft_consensus.cc:482] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:22.064649 17033 raft_consensus.cc:3037] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.065596 17033 raft_consensus.cc:504] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:22.065927 17033 leader_election.cc:288] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:22.066303 16025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87847912eaa4602abf9bd9cf2c698fd" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:22.066327 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a87847912eaa4602abf9bd9cf2c698fd" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:22.066437 15632 raft_consensus.cc:3037] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.066437 16025 raft_consensus.cc:3037] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.067413 15632 raft_consensus.cc:2454] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:22.067409 16025 raft_consensus.cc:2454] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 1.
I20240502 20:46:22.067746 15830 leader_election.cc:302] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:22.067920 17033 raft_consensus.cc:2781] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:22.068157 17033 raft_consensus.cc:686] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Becoming Leader. State: Replica: f7df976329f944319cef90e7116dfa96, State: Running, Role: LEADER
I20240502 20:46:22.068300 17033 consensus_queue.cc:237] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:22.070061 15482 catalog_manager.cc:5484] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7df976329f944319cef90e7116dfa96 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:22.146781 17084 raft_consensus.cc:482] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:22.146935 17084 raft_consensus.cc:504] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.147368 17084 leader_election.cc:288] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:22.147927 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a46ac0be3ab49e185c300eeedb8cd39" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:22.147927 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a46ac0be3ab49e185c300eeedb8cd39" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:22.148094 15761 raft_consensus.cc:2454] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:22.148094 15893 raft_consensus.cc:2454] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:22.148497 15566 leader_election.cc:302] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:22.148741 17084 raft_consensus.cc:2781] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:22.148810 17084 raft_consensus.cc:482] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:22.148860 17084 raft_consensus.cc:3037] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.149896 17084 raft_consensus.cc:504] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.150207 17084 leader_election.cc:288] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:22.150529 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a46ac0be3ab49e185c300eeedb8cd39" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:22.150558 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a46ac0be3ab49e185c300eeedb8cd39" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:22.150655 15761 raft_consensus.cc:3037] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.150662 15893 raft_consensus.cc:3037] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.151378 15761 raft_consensus.cc:2454] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:22.151434 15893 raft_consensus.cc:2454] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:22.151669 15566 leader_election.cc:302] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:22.151865 17084 raft_consensus.cc:2781] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:22.151948 17084 raft_consensus.cc:686] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:22.152055 17084 consensus_queue.cc:237] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.153904 15482 catalog_manager.cc:5484] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:22.299825 17129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:22.300099 17129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:22.303102 17129 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_7'
I20240502 20:46:22.402832 16025 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.402900 15632 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.403352 17033 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.403707 17033 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.404435 15761 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.404860 15893 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.404839 17084 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.406234 17017 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.412117 15894 raft_consensus.cc:1261] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.413079 16024 raft_consensus.cc:1261] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.413512 17029 consensus_queue.cc:1035] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.413830 17165 mvcc.cc:205] Tried to move back new op lower bound from 7023340676722671616 to 7023340675695939584. Current Snapshot: MvccSnapshot[applied={T|T < 7023340676722671616}]
I20240502 20:46:22.413808 17029 consensus_queue.cc:1035] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.418330 17166 mvcc.cc:205] Tried to move back new op lower bound from 7023340676716634112 to 7023340675353264128. Current Snapshot: MvccSnapshot[applied={T|T < 7023340676716634112}]
I20240502 20:46:22.451910 17167 mvcc.cc:205] Tried to move back new op lower bound from 7023340676834451456 to 7023340675201982464. Current Snapshot: MvccSnapshot[applied={T|T < 7023340676756221952}]
INSERT report
rows total: 2000
time total: 135.493 ms
time per row: 0.0677464 ms
I20240502 20:46:22.480782 15489 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:22.486716 15873 tablet_service.cc:1467] Processing CreateTablet for tablet 75f842e898b845f69b2617cc539b00db (DEFAULT_TABLE table=rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.486716 15610 tablet_service.cc:1467] Processing CreateTablet for tablet 75f842e898b845f69b2617cc539b00db (DEFAULT_TABLE table=rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.487042 15610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f842e898b845f69b2617cc539b00db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.487042 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f842e898b845f69b2617cc539b00db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.487493 15742 tablet_service.cc:1467] Processing CreateTablet for tablet 360284c2b0c34339bbaeb5a20ee193ac (DEFAULT_TABLE table=rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.487829 15742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360284c2b0c34339bbaeb5a20ee193ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.488096 15741 tablet_service.cc:1467] Processing CreateTablet for tablet 75f842e898b845f69b2617cc539b00db (DEFAULT_TABLE table=rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.488183 15874 tablet_service.cc:1467] Processing CreateTablet for tablet 7460cf8211d24a3d97085d1a36116a29 (DEFAULT_TABLE table=rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.488305 15741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f842e898b845f69b2617cc539b00db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.488425 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7460cf8211d24a3d97085d1a36116a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.490159 17196 tablet_bootstrap.cc:492] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:22.490698 16005 tablet_service.cc:1467] Processing CreateTablet for tablet 7460cf8211d24a3d97085d1a36116a29 (DEFAULT_TABLE table=rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.491014 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7460cf8211d24a3d97085d1a36116a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.491161 17196 tablet_bootstrap.cc:654] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.490698 16004 tablet_service.cc:1467] Processing CreateTablet for tablet 360284c2b0c34339bbaeb5a20ee193ac (DEFAULT_TABLE table=rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.492067 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360284c2b0c34339bbaeb5a20ee193ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.492199 17195 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:22.492233 15611 tablet_service.cc:1467] Processing CreateTablet for tablet 7460cf8211d24a3d97085d1a36116a29 (DEFAULT_TABLE table=rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.492484 15611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7460cf8211d24a3d97085d1a36116a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.493319 17195 tablet_bootstrap.cc:654] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.493724 17199 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:22.494333 15610 tablet_service.cc:1467] Processing CreateTablet for tablet 360284c2b0c34339bbaeb5a20ee193ac (DEFAULT_TABLE table=rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.494566 15610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360284c2b0c34339bbaeb5a20ee193ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.494674 17195 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:22.494685 17199 tablet_bootstrap.cc:654] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.494745 17195 ts_tablet_manager.cc:1367] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:22.495186 17195 raft_consensus.cc:348] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.495352 17195 raft_consensus.cc:374] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.495419 17195 raft_consensus.cc:729] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.495594 17195 consensus_queue.cc:260] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.495769 17199 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:22.495848 17199 ts_tablet_manager.cc:1367] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:22.496282 17199 raft_consensus.cc:348] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.496385 17199 raft_consensus.cc:374] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.496420 17199 raft_consensus.cc:729] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.496536 17199 consensus_queue.cc:260] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.496603 17195 ts_tablet_manager.cc:1398] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:22.496748 17195 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:22.496807 17199 ts_tablet_manager.cc:1398] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:22.496970 17199 tablet_bootstrap.cc:492] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:22.497520 17195 tablet_bootstrap.cc:654] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.497782 17199 tablet_bootstrap.cc:654] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.498451 17195 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:22.498513 17195 ts_tablet_manager.cc:1367] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:22.498852 17195 raft_consensus.cc:348] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.498951 17195 raft_consensus.cc:374] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.498979 17195 raft_consensus.cc:729] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.499076 17195 consensus_queue.cc:260] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.499295 17195 ts_tablet_manager.cc:1398] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:22.499415 17195 tablet_bootstrap.cc:492] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:22.499759 17199 tablet_bootstrap.cc:492] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:22.499838 17199 ts_tablet_manager.cc:1367] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:22.500226 17195 tablet_bootstrap.cc:654] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.500308 17199 raft_consensus.cc:348] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:22.500401 17199 raft_consensus.cc:374] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.500432 17199 raft_consensus.cc:729] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.500556 17199 consensus_queue.cc:260] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:22.500820 17199 ts_tablet_manager.cc:1398] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:22.501248 17197 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:22.502034 17195 tablet_bootstrap.cc:492] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:22.502107 17195 ts_tablet_manager.cc:1367] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:46:22.502279 17197 tablet_bootstrap.cc:654] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.502466 17195 raft_consensus.cc:348] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:22.502547 17195 raft_consensus.cc:374] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.502573 17195 raft_consensus.cc:729] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.502669 17195 consensus_queue.cc:260] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:22.502883 17195 ts_tablet_manager.cc:1398] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:22.503436 17197 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:22.503528 17197 ts_tablet_manager.cc:1367] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:22.504031 17197 raft_consensus.cc:348] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.504134 17197 raft_consensus.cc:374] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.504165 17197 raft_consensus.cc:729] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.504276 17197 consensus_queue.cc:260] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.504535 17197 ts_tablet_manager.cc:1398] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:22.504706 17197 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:22.505548 17197 tablet_bootstrap.cc:654] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.506812 17197 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:22.506899 17197 ts_tablet_manager.cc:1367] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:22.507392 17197 raft_consensus.cc:348] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.507486 17197 raft_consensus.cc:374] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.507521 17197 raft_consensus.cc:729] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.507642 17196 tablet_bootstrap.cc:492] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:22.507627 17197 consensus_queue.cc:260] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.507817 17196 ts_tablet_manager.cc:1367] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20240502 20:46:22.507951 17197 ts_tablet_manager.cc:1398] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:22.508282 17196 raft_consensus.cc:348] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:22.508401 17196 raft_consensus.cc:374] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.508471 17196 raft_consensus.cc:729] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.508615 17196 consensus_queue.cc:260] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:22.508874 17196 ts_tablet_manager.cc:1398] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:22.509130 17196 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:22.510003 17196 tablet_bootstrap.cc:654] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.516460 17196 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:22.516562 17196 ts_tablet_manager.cc:1367] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240502 20:46:22.516988 17196 raft_consensus.cc:348] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.517099 17196 raft_consensus.cc:374] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.517138 17196 raft_consensus.cc:729] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.517253 17196 consensus_queue.cc:260] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.517534 17196 ts_tablet_manager.cc:1398] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:22.518497 17013 raft_consensus.cc:482] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:22.518610 17013 raft_consensus.cc:504] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:22.519028 17013 leader_election.cc:288] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:22.519404 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360284c2b0c34339bbaeb5a20ee193ac" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:22.519424 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360284c2b0c34339bbaeb5a20ee193ac" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:22.519539 15761 raft_consensus.cc:2454] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:22.519548 15632 raft_consensus.cc:2454] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:22.519991 15959 leader_election.cc:302] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:22.520211 17013 raft_consensus.cc:2781] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:22.520275 17013 raft_consensus.cc:482] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:22.520315 17013 raft_consensus.cc:3037] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.521070 17013 raft_consensus.cc:504] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:22.521370 17013 leader_election.cc:288] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:22.521773 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360284c2b0c34339bbaeb5a20ee193ac" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:22.521862 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360284c2b0c34339bbaeb5a20ee193ac" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:22.521894 15632 raft_consensus.cc:3037] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.521958 15761 raft_consensus.cc:3037] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.522662 15632 raft_consensus.cc:2454] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:22.522845 15761 raft_consensus.cc:2454] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:22.523104 15959 leader_election.cc:302] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:22.523252 17013 raft_consensus.cc:2781] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:22.523355 17013 raft_consensus.cc:686] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:22.523496 17013 consensus_queue.cc:237] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } }
I20240502 20:46:22.525218 15489 catalog_manager.cc:5484] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:22.560060 17013 raft_consensus.cc:482] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:22.560184 17013 raft_consensus.cc:504] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.560564 17013 leader_election.cc:288] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:22.560952 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:22.560952 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:22.561110 15632 raft_consensus.cc:2454] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:22.561110 15893 raft_consensus.cc:2454] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:22.561407 15961 leader_election.cc:302] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:22.561611 17013 raft_consensus.cc:2781] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:22.561672 17013 raft_consensus.cc:482] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:22.561702 17013 raft_consensus.cc:3037] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.562525 17013 raft_consensus.cc:504] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.562841 17013 leader_election.cc:288] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:22.563122 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:22.563227 15632 raft_consensus.cc:3037] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.563212 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:22.563352 15893 raft_consensus.cc:3037] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.564119 15632 raft_consensus.cc:2454] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:22.564285 15893 raft_consensus.cc:2454] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:22.564409 15961 leader_election.cc:302] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:22.564585 17013 raft_consensus.cc:2781] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:22.564682 17013 raft_consensus.cc:686] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:22.565016 17013 consensus_queue.cc:237] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.566812 15489 catalog_manager.cc:5484] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:22.662707 17179 raft_consensus.cc:482] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:22.662842 17179 raft_consensus.cc:504] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.663254 17179 leader_election.cc:288] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:22.663739 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f842e898b845f69b2617cc539b00db" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:22.663714 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f842e898b845f69b2617cc539b00db" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:22.663877 15893 raft_consensus.cc:2454] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:22.663889 15761 raft_consensus.cc:2454] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:22.664188 15566 leader_election.cc:302] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:22.664351 17179 raft_consensus.cc:2781] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:22.664418 17179 raft_consensus.cc:482] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:22.664465 17179 raft_consensus.cc:3037] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.665344 17179 raft_consensus.cc:504] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.665683 17179 leader_election.cc:288] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:22.666054 15761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f842e898b845f69b2617cc539b00db" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:22.666077 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75f842e898b845f69b2617cc539b00db" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:22.666179 15761 raft_consensus.cc:3037] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.666219 15893 raft_consensus.cc:3037] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:22.666947 15761 raft_consensus.cc:2454] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:22.667008 15893 raft_consensus.cc:2454] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:22.667244 15566 leader_election.cc:302] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:22.667399 17179 raft_consensus.cc:2781] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:22.667534 17179 raft_consensus.cc:686] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:22.667709 17179 consensus_queue.cc:237] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } }
I20240502 20:46:22.670804 15489 catalog_manager.cc:5484] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:22.806998 17211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:22.807263 17211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:22.810384 17211 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_8'
I20240502 20:46:22.902341 15893 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.903028 15632 raft_consensus.cc:1261] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.903358 15631 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.903671 17089 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.904385 17013 consensus_queue.cc:1035] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.904683 17013 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.904767 15761 raft_consensus.cc:1261] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.910545 15894 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.911886 15761 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:22.912346 17017 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.912670 17017 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:22.913339 17089 consensus_queue.cc:1035] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 117.795 ms
time per row: 0.0588975 ms
I20240502 20:46:22.982784 15489 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44644:
name: "rebalance_test_table_9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:22.989558 15741 tablet_service.cc:1467] Processing CreateTablet for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 (DEFAULT_TABLE table=rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.989694 15873 tablet_service.cc:1467] Processing CreateTablet for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 (DEFAULT_TABLE table=rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.989953 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.989953 15741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.991645 15610 tablet_service.cc:1467] Processing CreateTablet for tablet 15e0404ac2e44c36aa58c7b4c7705c11 (DEFAULT_TABLE table=rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.992033 15610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15e0404ac2e44c36aa58c7b4c7705c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.992298 17197 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:22.992298 17196 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:22.993160 17196 tablet_bootstrap.cc:654] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.993160 17197 tablet_bootstrap.cc:654] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.994102 17195 tablet_bootstrap.cc:492] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f: Bootstrap starting.
I20240502 20:46:22.994421 17196 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:22.994413 16004 tablet_service.cc:1467] Processing CreateTablet for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 (DEFAULT_TABLE table=rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.994503 17196 ts_tablet_manager.cc:1367] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:22.994645 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.995015 17195 tablet_bootstrap.cc:654] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.994946 17196 raft_consensus.cc:348] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.995064 17196 raft_consensus.cc:374] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.995106 17196 raft_consensus.cc:729] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.995273 17196 consensus_queue.cc:260] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.995591 17196 ts_tablet_manager.cc:1398] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:22.996306 17195 tablet_bootstrap.cc:492] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f: No bootstrap required, opened a new log
I20240502 20:46:22.996312 17197 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:22.996384 17195 ts_tablet_manager.cc:1367] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 20:46:22.996384 17197 ts_tablet_manager.cc:1367] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:22.996521 17199 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:22.996824 17195 raft_consensus.cc:348] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:22.996824 17197 raft_consensus.cc:348] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.996937 17197 raft_consensus.cc:374] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.996937 17195 raft_consensus.cc:374] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:22.996969 17195 raft_consensus.cc:729] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.996969 17197 raft_consensus.cc:729] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:22.997093 17195 consensus_queue.cc:260] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:22.997105 17197 consensus_queue.cc:260] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:22.997360 17195 ts_tablet_manager.cc:1398] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:22.997361 17197 ts_tablet_manager.cc:1398] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:22.997413 17199 tablet_bootstrap.cc:654] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:22.997994 15741 tablet_service.cc:1467] Processing CreateTablet for tablet 281af65f89524fdeba2c97322a482009 (DEFAULT_TABLE table=rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:22.998252 15741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281af65f89524fdeba2c97322a482009. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:22.999926 17196 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:23.000039 15742 tablet_service.cc:1467] Processing CreateTablet for tablet 15e0404ac2e44c36aa58c7b4c7705c11 (DEFAULT_TABLE table=rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:23.000288 15742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15e0404ac2e44c36aa58c7b4c7705c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:23.000905 17196 tablet_bootstrap.cc:654] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:23.001860 15873 tablet_service.cc:1467] Processing CreateTablet for tablet 281af65f89524fdeba2c97322a482009 (DEFAULT_TABLE table=rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:23.001943 15874 tablet_service.cc:1467] Processing CreateTablet for tablet 15e0404ac2e44c36aa58c7b4c7705c11 (DEFAULT_TABLE table=rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:23.002112 15873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281af65f89524fdeba2c97322a482009. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:23.002259 15874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15e0404ac2e44c36aa58c7b4c7705c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:23.002910 16004 tablet_service.cc:1467] Processing CreateTablet for tablet 281af65f89524fdeba2c97322a482009 (DEFAULT_TABLE table=rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:23.003187 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281af65f89524fdeba2c97322a482009. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:23.004036 17197 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:23.004859 17197 tablet_bootstrap.cc:654] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:23.005321 17196 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:23.005409 17196 ts_tablet_manager.cc:1367] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:46:23.005894 17196 raft_consensus.cc:348] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.006007 17196 raft_consensus.cc:374] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:23.006042 17196 raft_consensus.cc:729] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:23.006189 17197 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:23.006162 17196 consensus_queue.cc:260] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.006258 17197 ts_tablet_manager.cc:1367] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:23.006457 17196 ts_tablet_manager.cc:1398] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:23.006639 17196 tablet_bootstrap.cc:492] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a: Bootstrap starting.
I20240502 20:46:23.006703 17197 raft_consensus.cc:348] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.006793 17197 raft_consensus.cc:374] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:23.006814 17197 raft_consensus.cc:729] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:23.007122 17197 consensus_queue.cc:260] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.007268 17199 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:23.007359 17199 ts_tablet_manager.cc:1367] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 20:46:23.007541 17197 ts_tablet_manager.cc:1398] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:23.007688 17197 tablet_bootstrap.cc:492] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96: Bootstrap starting.
I20240502 20:46:23.007862 17199 raft_consensus.cc:348] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:23.007951 17199 raft_consensus.cc:374] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:23.007985 17199 raft_consensus.cc:729] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:23.008108 17199 consensus_queue.cc:260] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:23.007710 17196 tablet_bootstrap.cc:654] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:23.008409 17199 ts_tablet_manager.cc:1398] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:23.008566 17199 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74: Bootstrap starting.
I20240502 20:46:23.009184 17197 tablet_bootstrap.cc:654] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:23.009315 17196 tablet_bootstrap.cc:492] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a: No bootstrap required, opened a new log
I20240502 20:46:23.009392 17196 ts_tablet_manager.cc:1367] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 20:46:23.009466 17199 tablet_bootstrap.cc:654] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:23.009810 17196 raft_consensus.cc:348] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.009907 17196 raft_consensus.cc:374] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:23.009943 17196 raft_consensus.cc:729] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Initialized, Role: FOLLOWER
I20240502 20:46:23.010042 17196 consensus_queue.cc:260] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.010294 17196 ts_tablet_manager.cc:1398] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:23.010219 17197 tablet_bootstrap.cc:492] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96: No bootstrap required, opened a new log
I20240502 20:46:23.010432 17197 ts_tablet_manager.cc:1367] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:23.010820 17197 raft_consensus.cc:348] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.010915 17197 raft_consensus.cc:374] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:23.010955 17197 raft_consensus.cc:729] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Initialized, Role: FOLLOWER
I20240502 20:46:23.011072 17197 consensus_queue.cc:260] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.011407 17197 ts_tablet_manager.cc:1398] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:23.012815 17199 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74: No bootstrap required, opened a new log
I20240502 20:46:23.012928 17199 ts_tablet_manager.cc:1367] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:23.013338 17199 raft_consensus.cc:348] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.013571 17199 raft_consensus.cc:374] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:23.013626 17199 raft_consensus.cc:729] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Initialized, Role: FOLLOWER
I20240502 20:46:23.013825 17199 consensus_queue.cc:260] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.014149 17199 ts_tablet_manager.cc:1398] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:23.041354 17029 raft_consensus.cc:482] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:23.041477 17029 raft_consensus.cc:504] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.041903 17029 leader_election.cc:288] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:23.042330 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281af65f89524fdeba2c97322a482009" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74" is_pre_election: true
I20240502 20:46:23.042340 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281af65f89524fdeba2c97322a482009" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:23.042479 16024 raft_consensus.cc:2454] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:23.042479 15893 raft_consensus.cc:2454] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:23.042801 15698 leader_election.cc:302] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:23.042958 17029 raft_consensus.cc:2781] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:23.043015 17029 raft_consensus.cc:482] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:23.043066 17029 raft_consensus.cc:3037] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:23.043972 17029 raft_consensus.cc:504] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.044327 17029 leader_election.cc:288] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Requested vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:23.044590 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281af65f89524fdeba2c97322a482009" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:23.044680 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281af65f89524fdeba2c97322a482009" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:23.044746 16024 raft_consensus.cc:3037] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:23.044811 15893 raft_consensus.cc:3037] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:23.045537 15893 raft_consensus.cc:2454] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 1.
I20240502 20:46:23.045800 15698 leader_election.cc:302] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:23.045938 17029 raft_consensus.cc:2781] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:23.046000 16024 raft_consensus.cc:2454] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 1.
I20240502 20:46:23.046020 17029 raft_consensus.cc:686] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Becoming Leader. State: Replica: 0dfebe1fc59a48debca946314a5e3d0a, State: Running, Role: LEADER
I20240502 20:46:23.046154 17029 consensus_queue.cc:237] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.048038 15481 catalog_manager.cc:5484] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130). New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:23.103374 17013 raft_consensus.cc:482] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:23.103505 17013 raft_consensus.cc:504] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:23.103955 17013 leader_election.cc:288] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:23.104246 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1fcf1751e8f4b978ecbdb2535b7e1f1" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:23.104380 15763 raft_consensus.cc:2454] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:23.104452 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1fcf1751e8f4b978ecbdb2535b7e1f1" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:23.104614 15893 raft_consensus.cc:2454] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 0.
I20240502 20:46:23.104622 15959 leader_election.cc:302] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:23.104774 17013 raft_consensus.cc:2781] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:23.104838 17013 raft_consensus.cc:482] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:23.104879 17013 raft_consensus.cc:3037] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:23.105656 17013 raft_consensus.cc:504] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:23.105927 17013 leader_election.cc:288] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Requested vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:23.106257 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1fcf1751e8f4b978ecbdb2535b7e1f1" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:23.106319 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1fcf1751e8f4b978ecbdb2535b7e1f1" candidate_uuid: "3be8cce319d343fca3df1cf166a55a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:23.106364 15763 raft_consensus.cc:3037] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:23.106433 15893 raft_consensus.cc:3037] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:23.107228 15763 raft_consensus.cc:2454] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:23.107514 15893 raft_consensus.cc:2454] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be8cce319d343fca3df1cf166a55a74 in term 1.
I20240502 20:46:23.107834 15959 leader_election.cc:302] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 3be8cce319d343fca3df1cf166a55a74; no voters:
I20240502 20:46:23.108021 17013 raft_consensus.cc:2781] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:23.108116 17013 raft_consensus.cc:686] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:23.108250 17013 consensus_queue.cc:237] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } }
I20240502 20:46:23.110105 15481 catalog_manager.cc:5484] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:23.153524 16917 raft_consensus.cc:482] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:23.153679 16917 raft_consensus.cc:504] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.154057 16917 leader_election.cc:288] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:23.154366 17084 raft_consensus.cc:482] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:23.154495 17084 raft_consensus.cc:504] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.154532 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e0404ac2e44c36aa58c7b4c7705c11" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:23.154609 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e0404ac2e44c36aa58c7b4c7705c11" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" is_pre_election: true
I20240502 20:46:23.154664 15893 raft_consensus.cc:2454] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:23.154749 15632 raft_consensus.cc:2454] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfebe1fc59a48debca946314a5e3d0a in term 0.
I20240502 20:46:23.154898 17084 leader_election.cc:288] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:23.155009 15698 leader_election.cc:302] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:23.155195 16917 raft_consensus.cc:2781] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:23.155257 16917 raft_consensus.cc:482] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:23.155310 16917 raft_consensus.cc:3037] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:23.155265 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e0404ac2e44c36aa58c7b4c7705c11" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a" is_pre_election: true
I20240502 20:46:23.155308 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e0404ac2e44c36aa58c7b4c7705c11" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96" is_pre_election: true
I20240502 20:46:23.155402 15893 raft_consensus.cc:2454] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 0.
I20240502 20:46:23.155779 15567 leader_election.cc:302] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:23.155956 17084 raft_consensus.cc:2781] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:23.156016 17084 raft_consensus.cc:482] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:23.156060 17084 raft_consensus.cc:3037] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:23.156358 16917 raft_consensus.cc:504] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.156543 15763 raft_consensus.cc:2379] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c5f48d02a284d0eb4b1fa3868ab669f in current term 1: Already voted for candidate 0dfebe1fc59a48debca946314a5e3d0a in this term.
I20240502 20:46:23.156723 16917 leader_election.cc:288] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:23.157153 17084 raft_consensus.cc:504] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.157343 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e0404ac2e44c36aa58c7b4c7705c11" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:23.157516 15632 raft_consensus.cc:2379] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0dfebe1fc59a48debca946314a5e3d0a in current term 1: Already voted for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in this term.
I20240502 20:46:23.157516 17084 leader_election.cc:288] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Requested vote from peers 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:23.157946 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e0404ac2e44c36aa58c7b4c7705c11" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:23.158025 15893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e0404ac2e44c36aa58c7b4c7705c11" candidate_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:23.158200 15763 raft_consensus.cc:2379] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c5f48d02a284d0eb4b1fa3868ab669f in current term 1: Already voted for candidate 0dfebe1fc59a48debca946314a5e3d0a in this term.
I20240502 20:46:23.158206 15893 raft_consensus.cc:3037] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:23.158317 15894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15e0404ac2e44c36aa58c7b4c7705c11" candidate_uuid: "0dfebe1fc59a48debca946314a5e3d0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:23.158804 15698 leader_election.cc:302] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a; no voters: 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96
I20240502 20:46:23.159006 16917 raft_consensus.cc:2726] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240502 20:46:23.159308 15893 raft_consensus.cc:2454] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c5f48d02a284d0eb4b1fa3868ab669f in term 1.
I20240502 20:46:23.159597 15567 leader_election.cc:302] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96; no voters: 0dfebe1fc59a48debca946314a5e3d0a
I20240502 20:46:23.159785 17084 raft_consensus.cc:2781] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:23.159991 17084 raft_consensus.cc:686] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Leader. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:23.160131 17084 consensus_queue.cc:237] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } }
I20240502 20:46:23.161844 15481 catalog_manager.cc:5484] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129). New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:23.306180 17258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:23.306457 17258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:23.309616 17258 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_9'
I20240502 20:46:23.390766 16024 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:23.390790 15893 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:23.391260 17029 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:23.391531 16917 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:23.399816 15894 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:23.400198 15893 raft_consensus.cc:1261] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:23.400444 15763 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:23.400519 17013 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:23.401476 17084 consensus_queue.cc:1035] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:23.402276 17013 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:23.433004 15762 raft_consensus.cc:1261] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:23.434962 17017 consensus_queue.cc:1035] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 124.491 ms
time per row: 0.0622454 ms
I20240502 20:46:23.477474 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.133:44363
--local_ip_for_outbound_sockets=127.9.82.133
--tserver_master_addrs=127.9.82.190:39049
--webserver_port=44291
--webserver_interface=127.9.82.133
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
W20240502 20:46:23.592327 17296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:23.592546 17296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:23.592608 17296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:23.595605 17296 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:23.595669 17296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:23.595785 17296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.133
I20240502 20:46:23.599308 17296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.133:44363
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.9.82.133
--webserver_port=44291
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.17296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.133
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:23.600237 17296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:23.601322 17296 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:23.609807 17302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:23.610587 17296 server_base.cc:1034] running on GCE node
W20240502 20:46:23.611485 17304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:23.612210 17301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:23.612684 17296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:23.613412 17296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:23.614578 17296 hybrid_clock.cc:648] HybridClock initialized: now 1714682783614550 us; error 44 us; skew 500 ppm
I20240502 20:46:23.621783 17296 webserver.cc:460] Webserver started at http://127.9.82.133:44291/ using document root <none> and password file <none>
I20240502 20:46:23.622373 17296 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:23.622454 17296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:23.626363 17296 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 20:46:23.628383 17310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:23.629457 17296 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:23.629570 17296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "049bb73c1cda4f3a95adddfc2a6ea66f"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:23.630030 17296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:23.646600 17296 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:23.647245 17296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:23.647408 17296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:23.647992 17296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:23.648862 17296 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:23.648910 17296 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:23.648964 17296 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:23.648994 17296 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:23.657778 17296 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.133:44363
I20240502 20:46:23.657825 17423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.133:44363 every 8 connection(s)
I20240502 20:46:23.658919 17296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 20:46:23.664806 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 17296
I20240502 20:46:23.665313 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.134:35373
--local_ip_for_outbound_sockets=127.9.82.134
--tserver_master_addrs=127.9.82.190:39049
--webserver_port=32973
--webserver_interface=127.9.82.134
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:23.669183 17424 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:23.669425 17424 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:23.670032 17424 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:23.671233 15487 ts_manager.cc:194] Re-registered known tserver with Master: 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363)
I20240502 20:46:23.671878 15487 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.133:55223
W20240502 20:46:23.786391 17427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:23.786633 17427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:23.786705 17427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:23.789834 17427 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:23.789916 17427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:23.790030 17427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.134
I20240502 20:46:23.793956 17427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.134:35373
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.9.82.134
--webserver_port=32973
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.17427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.134
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:23.794848 17427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:23.796237 17427 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:23.805140 17435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:23.806144 17432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:23.806949 17433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:23.807695 17427 server_base.cc:1034] running on GCE node
I20240502 20:46:23.808322 17427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:23.808972 17427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:23.810128 17427 hybrid_clock.cc:648] HybridClock initialized: now 1714682783810107 us; error 34 us; skew 500 ppm
I20240502 20:46:23.812394 17427 webserver.cc:460] Webserver started at http://127.9.82.134:32973/ using document root <none> and password file <none>
I20240502 20:46:23.812984 17427 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:23.813064 17427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:23.816533 17427 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20240502 20:46:23.818393 17441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:23.819414 17427 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:23.819542 17427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "376b7736472c4bf2836c4303abf8e6c3"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:23.820020 17427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:23.830991 17427 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:23.831547 17427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:23.831701 17427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:23.832327 17427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:23.833276 17427 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:23.833326 17427 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:23.833389 17427 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:23.833420 17427 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:23.842428 17427 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.134:35373
I20240502 20:46:23.842458 17554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.134:35373 every 8 connection(s)
I20240502 20:46:23.843437 17427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20240502 20:46:23.852257 17555 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:23.852480 17555 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:23.852624 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 17427
I20240502 20:46:23.852977 17555 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:23.853021 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.135:34733
--local_ip_for_outbound_sockets=127.9.82.135
--tserver_master_addrs=127.9.82.190:39049
--webserver_port=46491
--webserver_interface=127.9.82.135
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:23.853986 15487 ts_manager.cc:194] Re-registered known tserver with Master: 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373)
I20240502 20:46:23.854616 15487 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.134:54761
W20240502 20:46:23.975472 17558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:23.975798 17558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:23.975888 17558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:23.979120 17558 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:23.979192 17558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:23.979265 17558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.135
I20240502 20:46:23.983283 17558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.135:34733
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.9.82.135
--webserver_port=46491
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.17558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.135
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:23.984282 17558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:23.985427 17558 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:23.994232 17564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:23.994827 17566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:23.995869 17563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:23.996773 17558 server_base.cc:1034] running on GCE node
I20240502 20:46:23.997241 17558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:23.997848 17558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:23.999017 17558 hybrid_clock.cc:648] HybridClock initialized: now 1714682783998992 us; error 45 us; skew 500 ppm
I20240502 20:46:24.001130 17558 webserver.cc:460] Webserver started at http://127.9.82.135:46491/ using document root <none> and password file <none>
I20240502 20:46:24.001672 17558 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:24.001753 17558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:24.005226 17558 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 20:46:24.007241 17572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:24.008359 17558 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 20:46:24.008488 17558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "47eb2a910e8949308b382a74c55030b5"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:24.008898 17558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:24.020501 17558 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:24.021126 17558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:24.021284 17558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:24.021821 17558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:24.022683 17558 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:24.022732 17558 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:24.022787 17558 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:24.022819 17558 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:24.031445 17558 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.135:34733
I20240502 20:46:24.031472 17685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.135:34733 every 8 connection(s)
I20240502 20:46:24.032522 17558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 20:46:24.040620 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 17558
I20240502 20:46:24.041142 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.136:41687
--local_ip_for_outbound_sockets=127.9.82.136
--tserver_master_addrs=127.9.82.190:39049
--webserver_port=45065
--webserver_interface=127.9.82.136
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:24.041568 17686 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:24.041800 17686 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:24.042378 17686 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:24.043390 15487 ts_manager.cc:194] Re-registered known tserver with Master: 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733)
I20240502 20:46:24.044073 15487 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.135:55575
W20240502 20:46:24.156287 17689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:24.156550 17689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:24.156603 17689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:24.159824 17689 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:24.159917 17689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:24.160018 17689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.136
I20240502 20:46:24.163712 17689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.136:41687
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.9.82.136
--webserver_port=45065
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.17689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.136
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:24.164701 17689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:24.165874 17689 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:24.174443 17697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:24.175103 17694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:24.176023 17695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:24.176751 17689 server_base.cc:1034] running on GCE node
I20240502 20:46:24.177166 17689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:24.177773 17689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:24.178947 17689 hybrid_clock.cc:648] HybridClock initialized: now 1714682784178931 us; error 32 us; skew 500 ppm
I20240502 20:46:24.180974 17689 webserver.cc:460] Webserver started at http://127.9.82.136:45065/ using document root <none> and password file <none>
I20240502 20:46:24.181531 17689 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:24.181617 17689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:24.185314 17689 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 20:46:24.187160 17703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:24.188191 17689 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 20:46:24.188297 17689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "389fb867bde04f9980fe702dc1111079"
format_stamp: "Formatted at 2024-05-02 20:46:13 on dist-test-slave-2pss"
I20240502 20:46:24.188694 17689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:24.204983 17689 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:24.205631 17689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:24.205786 17689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:24.206341 17689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:24.207379 17689 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:24.207442 17689 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:24.207495 17689 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:24.207528 17689 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:24.216907 17689 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.136:41687
I20240502 20:46:24.217068 17816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.136:41687 every 8 connection(s)
I20240502 20:46:24.218143 17689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 20:46:24.219375 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 17689
I20240502 20:46:24.229187 17817 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:24.229405 17817 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:24.230134 17817 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:24.231138 15487 ts_manager.cc:194] Re-registered known tserver with Master: 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687)
I20240502 20:46:24.231916 15487 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.136:34967
W20240502 20:46:24.360711 17821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:24.361007 17821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:24.364492 17821 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 20:46:24.482678 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.487818 16004 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:24.488317 15610 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:24.491235 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.503635 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:24.513286 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:24.513427 17489 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.513972 17751 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.526325 17751 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.537669 17489 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.549782 17620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.557876 15610 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:24.561836 17620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.563993 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:24.568132 16004 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:24.573285 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:24.673933 17424 heartbeater.cc:503] Master 127.9.82.190:39049 was elected leader, sending a full tablet report...
I20240502 20:46:24.715814 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:24.716308 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.717298 17489 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.733992 16004 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:24.734256 17751 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.764680 15610 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:24.764933 17620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.765579 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
W20240502 20:46:24.803936 17939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:24.804240 17939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:24.808401 17939 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 20:46:24.856571 17555 heartbeater.cc:503] Master 127.9.82.190:39049 was elected leader, sending a full tablet report...
I20240502 20:46:24.923362 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.924526 17751 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.935699 17620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.940533 15610 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:24.943820 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:24.944296 16004 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:24.963563 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.967075 17489 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.967577 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:24.976291 17489 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.978173 16004 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:24.999485 17751 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:24.999564 17620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:25.012483 15610 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:25.030189 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:25.037508 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:25.045962 17686 heartbeater.cc:503] Master 127.9.82.190:39049 was elected leader, sending a full tablet report...
I20240502 20:46:25.103689 15763 consensus_queue.cc:237] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:25.105862 15631 raft_consensus.cc:1261] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.106122 16024 raft_consensus.cc:1261] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.106757 17029 consensus_queue.cc:1035] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.106998 18063 consensus_queue.cc:1035] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.110613 18064 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.111141 15631 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.115581 15482 catalog_manager.cc:5484] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:25.117244 15698 consensus_peers.cc:485] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c0e045d15114b8ea88ff5ef05f3c1e4. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.117838 16024 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.129618 16024 consensus_queue.cc:237] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:25.132153 15763 raft_consensus.cc:1261] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.132902 15631 raft_consensus.cc:1261] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.133440 17013 consensus_queue.cc:1035] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.136561 18078 consensus_queue.cc:1035] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.137032 18078 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.138789 15631 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.141212 15763 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.142153 15483 catalog_manager.cc:5484] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:25.151014 15961 consensus_peers.cc:485] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 360284c2b0c34339bbaeb5a20ee193ac. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.155606 16024 consensus_queue.cc:237] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:25.158183 15891 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.159147 15763 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.159637 17013 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.159938 18079 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.162752 17013 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.164726 15763 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.168155 15482 catalog_manager.cc:5484] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:25.177462 15960 consensus_peers.cc:485] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1fcf1751e8f4b978ecbdb2535b7e1f1. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.178088 15891 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.185731 16024 consensus_queue.cc:237] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:25.188248 15763 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.188911 18078 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.190676 15891 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.191955 18078 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.193712 18078 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.196396 15891 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.199823 15482 catalog_manager.cc:5484] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
W20240502 20:46:25.201995 15959 consensus_peers.cc:485] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1694de56984a4ca78f9dabaaca2677de. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.202744 15763 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.209904 15631 consensus_queue.cc:237] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:25.212050 16024 raft_consensus.cc:1261] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.212477 17017 consensus_queue.cc:1035] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.212854 15763 raft_consensus.cc:1261] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.213302 17017 consensus_queue.cc:1035] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.215129 17017 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.215579 15763 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.218564 15482 catalog_manager.cc:5484] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:25.222923 16024 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.232564 16024 consensus_queue.cc:237] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:25.234023 17817 heartbeater.cc:503] Master 127.9.82.190:39049 was elected leader, sending a full tablet report...
I20240502 20:46:25.234382 15763 raft_consensus.cc:1261] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.234768 18079 consensus_queue.cc:1035] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.236246 15631 raft_consensus.cc:1261] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.236718 18079 consensus_queue.cc:1035] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.240203 18079 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
W20240502 20:46:25.242801 15960 consensus_peers.cc:485] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a392f6644c1465cada45ddddf4ee2c5. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.242733 15762 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.246127 15482 catalog_manager.cc:5484] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.248762 15631 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
W20240502 20:46:25.249928 15568 consensus_peers.cc:485] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef8149e90bfc405db47acd6d6fe576ad. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.264194 15763 consensus_queue.cc:237] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:25.266508 15891 raft_consensus.cc:1261] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.267235 18064 consensus_queue.cc:1035] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.268257 15631 raft_consensus.cc:1261] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.269788 18064 consensus_queue.cc:1035] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 20:46:25.271641 15698 consensus_peers.cc:485] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1abc3674e948410296824189a95ae253. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.276867 18064 raft_consensus.cc:2932] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.277633 15631 raft_consensus.cc:2932] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.279246 15891 raft_consensus.cc:2932] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.281994 15482 catalog_manager.cc:5484] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:25.293532 15631 consensus_queue.cc:237] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
W20240502 20:46:25.294804 18066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:25.295118 18066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240502 20:46:25.296160 15763 raft_consensus.cc:1261] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.296766 15891 raft_consensus.cc:1261] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.297317 17971 consensus_queue.cc:1035] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.297590 18106 consensus_queue.cc:1035] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 20:46:25.299376 18066 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20240502 20:46:25.300891 15567 consensus_peers.cc:485] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15e0404ac2e44c36aa58c7b4c7705c11. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.301990 17971 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.302572 15891 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.306632 15490 catalog_manager.cc:5484] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.308965 15763 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.322042 15891 consensus_queue.cc:237] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:25.324270 16024 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.324322 15631 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.324956 17174 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.326001 17174 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.327478 17998 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.328091 16024 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.331427 15483 catalog_manager.cc:5484] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
W20240502 20:46:25.332937 15828 consensus_peers.cc:485] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce9c2a00fa6b43938a7eb89a82bae6ce. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.337527 15631 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.343051 16024 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:25.344759 15763 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.345377 15631 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.345711 18079 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 20:46:25.346213 15961 consensus_peers.cc:485] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2436658a9dd54854a8920f9242068ee7. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.346482 17013 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.348277 18078 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.348660 15763 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.351352 15483 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.353806 15631 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.362335 15631 consensus_queue.cc:237] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:25.364077 15891 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.364385 15763 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.364562 18106 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.364835 17017 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.366453 17971 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.367259 15763 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.368309 15891 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
W20240502 20:46:25.368846 15566 consensus_peers.cc:485] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6521649137d4bab9ecf18c8f81abaed. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.371352 15484 catalog_manager.cc:5484] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.380968 15891 consensus_queue.cc:237] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:25.382599 15763 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.383009 16024 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.383621 17174 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.385248 17174 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.387638 17174 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
W20240502 20:46:25.390240 15829 consensus_peers.cc:485] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 167efd92157a42ec84ea1cfb1de4a15c. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.390646 16024 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.392411 15763 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.393481 15484 catalog_manager.cc:5484] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.402158 15891 consensus_queue.cc:237] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:25.403673 15631 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.404191 17174 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.405771 16024 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.406199 17174 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.409971 18150 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
W20240502 20:46:25.410243 15829 consensus_peers.cc:485] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86ff3421109a484f869fd29f63392186. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.412226 15631 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.414762 16025 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.414922 15482 catalog_manager.cc:5484] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:25.428730 15631 consensus_queue.cc:237] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:25.430667 16025 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.430675 15891 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:46:25.431087 15568 consensus_peers.cc:485] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: effe8b25103e4fd6abafde8c7b425165. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.431330 18180 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.431716 18180 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.434496 18180 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.436717 16025 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.436818 15891 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.438663 15490 catalog_manager.cc:5484] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:25.450452 15763 consensus_queue.cc:237] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:25.451663 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:25.453157 17751 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:25.453685 16025 raft_consensus.cc:1261] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.453790 15891 raft_consensus.cc:1261] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.454222 18064 consensus_queue.cc:1035] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.454414 17029 consensus_queue.cc:1035] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.457365 17489 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
W20240502 20:46:25.461045 15697 consensus_peers.cc:485] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f015e46a8a27436dbd88b97dd1798cb0. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.465387 18064 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.468178 15891 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.468752 15483 catalog_manager.cc:5484] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:25.472098 16025 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:25.473659 16004 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:25.474967 17620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:25.476495 15610 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:25.478366 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:25.484418 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:25.518828 15631 consensus_queue.cc:237] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:25.523691 15891 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.524578 17971 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.524654 15763 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.527143 17971 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 20:46:25.528662 15567 consensus_peers.cc:485] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a46ac0be3ab49e185c300eeedb8cd39. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.529453 18180 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.531633 15763 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.532210 15485 catalog_manager.cc:5484] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:25.537453 15891 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
Runtime error: ksck discovered errors
I20240502 20:46:25.545234 16025 consensus_queue.cc:237] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:25.546820 15891 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.546854 15631 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:46:25.547058 15961 consensus_peers.cc:485] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15214db73de54afba83b983bc2865948. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.547245 18078 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.547469 18079 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.549260 18079 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.550215 15631 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.551928 15891 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:25.554050 15490 catalog_manager.cc:5484] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:25.555339 18252 ts_tablet_manager.cc:902] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:25.556236 18252 tablet_copy_client.cc:308] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:25.562125 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 360284c2b0c34339bbaeb5a20ee193ac from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:49865)
I20240502 20:46:25.562263 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 360284c2b0c34339bbaeb5a20ee193ac from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:49865: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-360284c2b0c34339bbaeb5a20ee193ac
I20240502 20:46:25.563452 16045 tablet_copy_source_session.cc:205] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.566112 15631 consensus_queue.cc:237] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:25.567293 18252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360284c2b0c34339bbaeb5a20ee193ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.567862 15763 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.568228 15891 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.568276 18180 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.568627 18180 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 20:46:25.568773 15567 consensus_peers.cc:485] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60c7001f651848b788926cde86a3c0f6. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.570803 17971 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.573175 15891 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.575016 18252 tablet_copy_client.cc:783] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.575209 18252 tablet_copy_client.cc:647] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.575991 15483 catalog_manager.cc:5484] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:25.577004 18256 tablet_copy_client.cc:1002] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.585256 15763 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:25.591668 15631 consensus_queue.cc:237] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:25.593240 15893 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.593587 16025 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:25.593616 17017 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 20:46:25.594097 15567 consensus_peers.cc:485] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e16f4c2f41e41eeb40b67b147296581. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:25.594513 18106 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:25.595575 18180 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.597448 15893 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.598783 16025 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:25.599603 15485 catalog_manager.cc:5484] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:25.601706 18279 ts_tablet_manager.cc:902] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:25.602501 18279 tablet_copy_client.cc:308] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:25.606715 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 1694de56984a4ca78f9dabaaca2677de from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:35909)
I20240502 20:46:25.606819 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 1694de56984a4ca78f9dabaaca2677de from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:35909: session id = 376b7736472c4bf2836c4303abf8e6c3-1694de56984a4ca78f9dabaaca2677de
I20240502 20:46:25.607592 16045 tablet_copy_source_session.cc:205] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.610510 18279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1694de56984a4ca78f9dabaaca2677de. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.616429 18279 tablet_copy_client.cc:783] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.616608 18279 tablet_copy_client.cc:647] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.617709 18281 tablet_copy_client.cc:1002] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.634394 18301 ts_tablet_manager.cc:902] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:25.635288 18301 tablet_copy_client.cc:308] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:32937
I20240502 20:46:25.640295 15783 tablet_copy_service.cc:140] P 0dfebe1fc59a48debca946314a5e3d0a: Received BeginTabletCopySession request for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4 from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:43761)
I20240502 20:46:25.640460 15783 tablet_copy_service.cc:161] P 0dfebe1fc59a48debca946314a5e3d0a: Beginning new tablet copy session on tablet 4c0e045d15114b8ea88ff5ef05f3c1e4 from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:43761: session id = 47eb2a910e8949308b382a74c55030b5-4c0e045d15114b8ea88ff5ef05f3c1e4
I20240502 20:46:25.640982 18311 ts_tablet_manager.cc:902] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:25.641690 18311 tablet_copy_client.cc:308] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:25.642545 15783 tablet_copy_source_session.cc:205] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.646128 18301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.652947 18301 tablet_copy_client.cc:783] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.653255 18301 tablet_copy_client.cc:647] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.654983 18303 tablet_copy_client.cc:1002] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.656392 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet ef8149e90bfc405db47acd6d6fe576ad from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:46873)
I20240502 20:46:25.656548 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet ef8149e90bfc405db47acd6d6fe576ad from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:46873: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-ef8149e90bfc405db47acd6d6fe576ad
I20240502 20:46:25.657729 15652 tablet_copy_source_session.cc:205] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.658890 18311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef8149e90bfc405db47acd6d6fe576ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.660811 18311 tablet_copy_client.cc:783] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.660982 18311 tablet_copy_client.cc:647] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.662137 18313 tablet_copy_client.cc:1002] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.711966 18356 ts_tablet_manager.cc:902] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:25.712812 18356 tablet_copy_client.cc:308] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:25.713002 18348 ts_tablet_manager.cc:902] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:25.713555 18348 tablet_copy_client.cc:308] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:32937
W20240502 20:46:25.714569 18263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:25.715417 18263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240502 20:46:25.719853 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:38827)
I20240502 20:46:25.719969 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:38827: session id = 389fb867bde04f9980fe702dc1111079-d1fcf1751e8f4b978ecbdb2535b7e1f1
W20240502 20:46:25.720356 18263 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 20:46:25.722242 16045 tablet_copy_source_session.cc:205] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.724769 15783 tablet_copy_service.cc:140] P 0dfebe1fc59a48debca946314a5e3d0a: Received BeginTabletCopySession request for tablet 1abc3674e948410296824189a95ae253 from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:43715)
I20240502 20:46:25.724887 15783 tablet_copy_service.cc:161] P 0dfebe1fc59a48debca946314a5e3d0a: Beginning new tablet copy session on tablet 1abc3674e948410296824189a95ae253 from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:43715: session id = 389fb867bde04f9980fe702dc1111079-1abc3674e948410296824189a95ae253
I20240502 20:46:25.725929 15783 tablet_copy_source_session.cc:205] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.726068 18356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.726737 18348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1abc3674e948410296824189a95ae253. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.732826 18348 tablet_copy_client.cc:783] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.733016 18348 tablet_copy_client.cc:647] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.732802 18356 tablet_copy_client.cc:783] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.733319 18356 tablet_copy_client.cc:647] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.734436 18362 tablet_copy_client.cc:1002] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.734762 18358 tablet_copy_client.cc:1002] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.759924 18400 ts_tablet_manager.cc:902] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:25.760960 18400 tablet_copy_client.cc:308] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:25.765133 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet ce9c2a00fa6b43938a7eb89a82bae6ce from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:42117)
I20240502 20:46:25.765290 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet ce9c2a00fa6b43938a7eb89a82bae6ce from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:42117: session id = 376b7736472c4bf2836c4303abf8e6c3-ce9c2a00fa6b43938a7eb89a82bae6ce
I20240502 20:46:25.766628 15914 tablet_copy_source_session.cc:205] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.768136 18400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce9c2a00fa6b43938a7eb89a82bae6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.770493 18416 ts_tablet_manager.cc:902] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:25.770587 18400 tablet_copy_client.cc:783] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.770737 18400 tablet_copy_client.cc:647] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.771051 18416 tablet_copy_client.cc:308] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:25.772341 18404 tablet_copy_client.cc:1002] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.775889 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet a6521649137d4bab9ecf18c8f81abaed from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:50153)
I20240502 20:46:25.776003 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet a6521649137d4bab9ecf18c8f81abaed from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:50153: session id = 376b7736472c4bf2836c4303abf8e6c3-a6521649137d4bab9ecf18c8f81abaed
I20240502 20:46:25.776966 15652 tablet_copy_source_session.cc:205] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.777853 18416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6521649137d4bab9ecf18c8f81abaed. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.779872 18416 tablet_copy_client.cc:783] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.780030 18416 tablet_copy_client.cc:647] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.781000 18418 tablet_copy_client.cc:1002] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.799471 18441 ts_tablet_manager.cc:902] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:25.800192 18441 tablet_copy_client.cc:308] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:25.805368 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 8a392f6644c1465cada45ddddf4ee2c5 from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:58231)
I20240502 20:46:25.805542 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 8a392f6644c1465cada45ddddf4ee2c5 from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:58231: session id = 47eb2a910e8949308b382a74c55030b5-8a392f6644c1465cada45ddddf4ee2c5
I20240502 20:46:25.806581 16045 tablet_copy_source_session.cc:205] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.808261 18441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a392f6644c1465cada45ddddf4ee2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.810739 18441 tablet_copy_client.cc:783] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.810930 18441 tablet_copy_client.cc:647] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.811975 18445 tablet_copy_client.cc:1002] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.828929 17751 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:25.831393 16004 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:25.832898 15610 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:25.835095 17489 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:25.835531 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:25.839326 17620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:25.841135 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:25.861958 18457 ts_tablet_manager.cc:902] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:25.862646 18457 tablet_copy_client.cc:308] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:25.863173 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet effe8b25103e4fd6abafde8c7b425165 from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:46873)
I20240502 20:46:25.863273 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet effe8b25103e4fd6abafde8c7b425165 from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:46873: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-effe8b25103e4fd6abafde8c7b425165
I20240502 20:46:25.864230 15652 tablet_copy_source_session.cc:205] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.865232 18457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effe8b25103e4fd6abafde8c7b425165. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.867780 18457 tablet_copy_client.cc:783] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.868108 18457 tablet_copy_client.cc:647] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.880964 18458 tablet_copy_client.cc:1002] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.881155 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:25.884847 18462 ts_tablet_manager.cc:902] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:25.885663 18462 tablet_copy_client.cc:308] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:25.889029 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 15e0404ac2e44c36aa58c7b4c7705c11 from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:53037)
I20240502 20:46:25.889132 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 15e0404ac2e44c36aa58c7b4c7705c11 from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:53037: session id = 47eb2a910e8949308b382a74c55030b5-15e0404ac2e44c36aa58c7b4c7705c11
I20240502 20:46:25.889881 15652 tablet_copy_source_session.cc:205] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.890722 18462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15e0404ac2e44c36aa58c7b4c7705c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.892638 18462 tablet_copy_client.cc:783] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.892824 18462 tablet_copy_client.cc:647] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.893765 18466 tablet_copy_client.cc:1002] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.895432 18467 ts_tablet_manager.cc:902] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:25.896025 18467 tablet_copy_client.cc:308] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:25.896529 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 2436658a9dd54854a8920f9242068ee7 from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:49865)
I20240502 20:46:25.896623 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 2436658a9dd54854a8920f9242068ee7 from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:49865: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-2436658a9dd54854a8920f9242068ee7
I20240502 20:46:25.897356 16045 tablet_copy_source_session.cc:205] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.898102 18467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2436658a9dd54854a8920f9242068ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.899938 18467 tablet_copy_client.cc:783] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.900146 18467 tablet_copy_client.cc:647] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.901099 18469 tablet_copy_client.cc:1002] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.905063 18472 ts_tablet_manager.cc:902] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:25.905656 18472 tablet_copy_client.cc:308] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:25.909760 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet 86ff3421109a484f869fd29f63392186 from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:43011)
I20240502 20:46:25.909865 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet 86ff3421109a484f869fd29f63392186 from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:43011: session id = 47eb2a910e8949308b382a74c55030b5-86ff3421109a484f869fd29f63392186
I20240502 20:46:25.910960 15914 tablet_copy_source_session.cc:205] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.911962 18472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86ff3421109a484f869fd29f63392186. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.914180 18472 tablet_copy_client.cc:783] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.914317 18472 tablet_copy_client.cc:647] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.915431 18474 tablet_copy_client.cc:1002] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
Runtime error: ksck discovered errors
I20240502 20:46:25.931699 18477 ts_tablet_manager.cc:902] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:25.932368 18477 tablet_copy_client.cc:308] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:25.933194 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.137:0
--local_ip_for_outbound_sockets=127.9.82.137
--webserver_interface=127.9.82.137
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39049
--builtin_ntp_servers=127.9.82.148:34563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 20:46:25.936352 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet 167efd92157a42ec84ea1cfb1de4a15c from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:35275)
I20240502 20:46:25.936487 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet 167efd92157a42ec84ea1cfb1de4a15c from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:35275: session id = 389fb867bde04f9980fe702dc1111079-167efd92157a42ec84ea1cfb1de4a15c
I20240502 20:46:25.937819 15914 tablet_copy_source_session.cc:205] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.938820 18477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167efd92157a42ec84ea1cfb1de4a15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.940824 18477 tablet_copy_client.cc:783] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.940973 18477 tablet_copy_client.cc:647] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.942173 18481 tablet_copy_client.cc:1002] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:25.958452 18483 ts_tablet_manager.cc:902] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:25.959076 18483 tablet_copy_client.cc:308] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:32937
I20240502 20:46:25.962718 15783 tablet_copy_service.cc:140] P 0dfebe1fc59a48debca946314a5e3d0a: Received BeginTabletCopySession request for tablet f015e46a8a27436dbd88b97dd1798cb0 from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:38207)
I20240502 20:46:25.962824 15783 tablet_copy_service.cc:161] P 0dfebe1fc59a48debca946314a5e3d0a: Beginning new tablet copy session on tablet f015e46a8a27436dbd88b97dd1798cb0 from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:38207: session id = 376b7736472c4bf2836c4303abf8e6c3-f015e46a8a27436dbd88b97dd1798cb0
I20240502 20:46:25.963811 15783 tablet_copy_source_session.cc:205] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:25.964666 18483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f015e46a8a27436dbd88b97dd1798cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:25.966878 18483 tablet_copy_client.cc:783] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:25.967028 18483 tablet_copy_client.cc:647] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:25.967978 18487 tablet_copy_client.cc:1002] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:26.021694 18523 ts_tablet_manager.cc:902] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:26.022385 18523 tablet_copy_client.cc:308] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:26.023023 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 60c7001f651848b788926cde86a3c0f6 from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:53037)
I20240502 20:46:26.023142 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 60c7001f651848b788926cde86a3c0f6 from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:53037: session id = 47eb2a910e8949308b382a74c55030b5-60c7001f651848b788926cde86a3c0f6
I20240502 20:46:26.023970 15652 tablet_copy_source_session.cc:205] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:26.024848 18523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60c7001f651848b788926cde86a3c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:26.028380 18523 tablet_copy_client.cc:783] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:26.028600 18523 tablet_copy_client.cc:647] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:26.030953 18525 tablet_copy_client.cc:1002] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
W20240502 20:46:26.071368 18482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:26.071593 18482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:26.071661 18482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:26.075496 18482 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:26.075572 18482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:26.075671 18482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.137
I20240502 20:46:26.079401 18482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:34563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.137:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--webserver_interface=127.9.82.137
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.9.82.190:39049
--never_fsync=true
--heap_profile_path=/tmp/kudu.18482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.137
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:26.080384 18482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:26.081756 18482 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:26.091176 18578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:26.092095 18577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:26.093457 18482 server_base.cc:1034] running on GCE node
W20240502 20:46:26.097807 18580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:26.098620 18482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:26.099362 18482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:26.102666 18482 hybrid_clock.cc:648] HybridClock initialized: now 1714682786102600 us; error 77 us; skew 500 ppm
I20240502 20:46:26.105285 18482 webserver.cc:460] Webserver started at http://127.9.82.137:39435/ using document root <none> and password file <none>
I20240502 20:46:26.106011 18482 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:26.106096 18482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:26.106329 18482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:26.109651 18482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/instance:
uuid: "0eff851f85a5413c8847f817e3742379"
format_stamp: "Formatted at 2024-05-02 20:46:26 on dist-test-slave-2pss"
I20240502 20:46:26.110327 18482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal/instance:
uuid: "0eff851f85a5413c8847f817e3742379"
format_stamp: "Formatted at 2024-05-02 20:46:26 on dist-test-slave-2pss"
I20240502 20:46:26.114838 18482 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20240502 20:46:26.116318 18596 ts_tablet_manager.cc:902] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:26.117193 18596 tablet_copy_client.cc:308] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:26.120111 18607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:26.121641 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 8a46ac0be3ab49e185c300eeedb8cd39 from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:58537)
I20240502 20:46:26.121759 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 8a46ac0be3ab49e185c300eeedb8cd39 from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:58537: session id = 389fb867bde04f9980fe702dc1111079-8a46ac0be3ab49e185c300eeedb8cd39
I20240502 20:46:26.122532 18482 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20240502 20:46:26.122634 15652 tablet_copy_source_session.cc:205] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:26.122702 18482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
uuid: "0eff851f85a5413c8847f817e3742379"
format_stamp: "Formatted at 2024-05-02 20:46:26 on dist-test-slave-2pss"
I20240502 20:46:26.122814 18482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:26.124323 18596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a46ac0be3ab49e185c300eeedb8cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:26.126266 18596 tablet_copy_client.cc:783] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:26.126431 18596 tablet_copy_client.cc:647] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:26.127519 18605 tablet_copy_client.cc:1002] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:26.138165 18482 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:26.138772 18482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:26.138931 18482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:26.139595 18482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:26.140913 18482 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:26.140974 18482 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:26.141052 18482 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:26.141085 18482 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:26.148030 18696 ts_tablet_manager.cc:902] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:26.148627 18696 tablet_copy_client.cc:308] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:26.149225 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 15214db73de54afba83b983bc2865948 from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:49865)
I20240502 20:46:26.149340 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 15214db73de54afba83b983bc2865948 from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:49865: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-15214db73de54afba83b983bc2865948
I20240502 20:46:26.150192 16045 tablet_copy_source_session.cc:205] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:26.150758 18482 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.137:37247
I20240502 20:46:26.150892 18726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.137:37247 every 8 connection(s)
I20240502 20:46:26.151127 18696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15214db73de54afba83b983bc2865948. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:26.151865 18482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb
I20240502 20:46:26.153107 18696 tablet_copy_client.cc:783] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:26.153285 18696 tablet_copy_client.cc:647] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:26.154346 18702 tablet_copy_client.cc:1002] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:26.161137 18727 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39049
I20240502 20:46:26.161379 18727 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:26.161722 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 18482
I20240502 20:46:26.161891 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal/instance
I20240502 20:46:26.162029 18727 heartbeater.cc:511] Master 127.9.82.190:39049 requested a full tablet report, sending...
I20240502 20:46:26.163019 15482 ts_manager.cc:194] Registered new tserver with Master: 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247)
I20240502 20:46:26.163585 15482 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.137:44027
I20240502 20:46:26.207093 18730 ts_tablet_manager.cc:902] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:26.207739 18730 tablet_copy_client.cc:308] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:26.208343 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 3e16f4c2f41e41eeb40b67b147296581 from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:58537)
I20240502 20:46:26.208462 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 3e16f4c2f41e41eeb40b67b147296581 from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:58537: session id = 389fb867bde04f9980fe702dc1111079-3e16f4c2f41e41eeb40b67b147296581
I20240502 20:46:26.209159 15652 tablet_copy_source_session.cc:205] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:26.210047 18730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e16f4c2f41e41eeb40b67b147296581. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:26.212069 18730 tablet_copy_client.cc:783] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:26.212219 18730 tablet_copy_client.cc:647] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:26.213428 18734 tablet_copy_client.cc:1002] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:27.077402 18252 tablet_copy_client.cc:523] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.079304 18252 tablet_bootstrap.cc:492] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:27.085013 18252 log.cc:824] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:27.105473 18252 tablet_bootstrap.cc:492] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.105855 18252 tablet_bootstrap.cc:492] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:27.106206 18252 ts_tablet_manager.cc:1367] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.027s user 0.026s sys 0.000s
I20240502 20:46:27.108415 18252 raft_consensus.cc:348] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.108636 18252 raft_consensus.cc:729] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:27.108970 18252 consensus_queue.cc:260] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.109711 18252 ts_tablet_manager.cc:1398] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
I20240502 20:46:27.110672 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-360284c2b0c34339bbaeb5a20ee193ac received from {username='slave'} at 127.9.82.133:49865
I20240502 20:46:27.110776 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-360284c2b0c34339bbaeb5a20ee193ac on tablet 360284c2b0c34339bbaeb5a20ee193ac with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:27.118165 18279 tablet_copy_client.cc:523] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.120113 18279 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:27.125890 18279 log.cc:824] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:27.146761 18279 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.147120 18279 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:27.147439 18279 ts_tablet_manager.cc:1367] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.027s user 0.021s sys 0.003s
I20240502 20:46:27.149413 18279 raft_consensus.cc:348] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:27.149641 18279 raft_consensus.cc:729] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:27.149966 18279 consensus_queue.cc:260] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:27.150914 18279 ts_tablet_manager.cc:1398] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.003s user 0.006s sys 0.001s
I20240502 20:46:27.151538 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-1694de56984a4ca78f9dabaaca2677de received from {username='slave'} at 127.9.82.134:35909
I20240502 20:46:27.151626 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-1694de56984a4ca78f9dabaaca2677de on tablet 1694de56984a4ca78f9dabaaca2677de with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:27.155366 18301 tablet_copy_client.cc:523] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.157076 18301 tablet_bootstrap.cc:492] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:27.162084 18301 log.cc:824] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:27.162508 18311 tablet_copy_client.cc:523] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.164084 18311 tablet_bootstrap.cc:492] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:27.165477 18727 heartbeater.cc:503] Master 127.9.82.190:39049 was elected leader, sending a full tablet report...
I20240502 20:46:27.186915 17509 raft_consensus.cc:1203] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.191502 18301 tablet_bootstrap.cc:492] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.191929 18301 tablet_bootstrap.cc:492] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:27.192282 18301 ts_tablet_manager.cc:1367] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.035s user 0.036s sys 0.000s
I20240502 20:46:27.193238 18311 tablet_bootstrap.cc:492] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.193521 18311 tablet_bootstrap.cc:492] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:27.193681 18311 ts_tablet_manager.cc:1367] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.030s user 0.026s sys 0.000s
I20240502 20:46:27.194239 18311 raft_consensus.cc:348] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.194383 18311 raft_consensus.cc:729] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:27.194486 18311 consensus_queue.cc:260] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.194844 18311 ts_tablet_manager.cc:1398] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:46:27.195019 18301 raft_consensus.cc:348] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.195281 18301 raft_consensus.cc:729] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:27.195423 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-ef8149e90bfc405db47acd6d6fe576ad received from {username='slave'} at 127.9.82.133:46873
I20240502 20:46:27.195541 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-ef8149e90bfc405db47acd6d6fe576ad on tablet ef8149e90bfc405db47acd6d6fe576ad with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:27.195659 18301 consensus_queue.cc:260] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.196537 18301 ts_tablet_manager.cc:1398] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 20:46:27.197202 15783 tablet_copy_service.cc:342] P 0dfebe1fc59a48debca946314a5e3d0a: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-4c0e045d15114b8ea88ff5ef05f3c1e4 received from {username='slave'} at 127.9.82.135:43761
I20240502 20:46:27.197309 15783 tablet_copy_service.cc:433] P 0dfebe1fc59a48debca946314a5e3d0a: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-4c0e045d15114b8ea88ff5ef05f3c1e4 on tablet 4c0e045d15114b8ea88ff5ef05f3c1e4 with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:27.234988 18348 tablet_copy_client.cc:523] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.234997 18356 tablet_copy_client.cc:523] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.237378 18356 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:27.237378 18348 tablet_bootstrap.cc:492] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:27.243048 18356 log.cc:824] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:27.262501 18356 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.262687 18348 tablet_bootstrap.cc:492] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.262871 18356 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:27.262952 18348 tablet_bootstrap.cc:492] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:27.263187 18348 ts_tablet_manager.cc:1367] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.026s user 0.016s sys 0.005s
I20240502 20:46:27.263188 18356 ts_tablet_manager.cc:1367] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.026s user 0.019s sys 0.004s
I20240502 20:46:27.265363 18356 raft_consensus.cc:348] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.265364 18348 raft_consensus.cc:348] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.265627 18356 raft_consensus.cc:729] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:27.265635 18348 raft_consensus.cc:729] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:27.265969 18348 consensus_queue.cc:260] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.265969 18356 consensus_queue.cc:260] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.266750 18348 ts_tablet_manager.cc:1398] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
I20240502 20:46:27.266757 18356 ts_tablet_manager.cc:1398] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 20:46:27.267313 15783 tablet_copy_service.cc:342] P 0dfebe1fc59a48debca946314a5e3d0a: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-1abc3674e948410296824189a95ae253 received from {username='slave'} at 127.9.82.136:43715
I20240502 20:46:27.267392 15783 tablet_copy_service.cc:433] P 0dfebe1fc59a48debca946314a5e3d0a: ending tablet copy session 389fb867bde04f9980fe702dc1111079-1abc3674e948410296824189a95ae253 on tablet 1abc3674e948410296824189a95ae253 with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:27.267833 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-d1fcf1751e8f4b978ecbdb2535b7e1f1 received from {username='slave'} at 127.9.82.136:38827
I20240502 20:46:27.267917 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 389fb867bde04f9980fe702dc1111079-d1fcf1751e8f4b978ecbdb2535b7e1f1 on tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:27.272712 18400 tablet_copy_client.cc:523] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.274078 18400 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:27.281345 18416 tablet_copy_client.cc:523] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.282692 18416 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:27.297876 18400 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.298213 18400 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:27.298467 18400 ts_tablet_manager.cc:1367] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.024s user 0.025s sys 0.000s
I20240502 20:46:27.299067 18400 raft_consensus.cc:348] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:27.299203 18400 raft_consensus.cc:729] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:27.299330 18400 consensus_queue.cc:260] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:27.299664 18400 ts_tablet_manager.cc:1398] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:27.300354 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-ce9c2a00fa6b43938a7eb89a82bae6ce received from {username='slave'} at 127.9.82.134:42117
I20240502 20:46:27.300459 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-ce9c2a00fa6b43938a7eb89a82bae6ce on tablet ce9c2a00fa6b43938a7eb89a82bae6ce with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:27.308166 18416 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.308524 18416 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:27.308773 18416 ts_tablet_manager.cc:1367] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.026s user 0.020s sys 0.004s
I20240502 20:46:27.309301 18416 raft_consensus.cc:348] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:27.309420 18416 raft_consensus.cc:729] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:27.309504 18416 consensus_queue.cc:260] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:27.309862 18416 ts_tablet_manager.cc:1398] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:46:27.310393 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-a6521649137d4bab9ecf18c8f81abaed received from {username='slave'} at 127.9.82.134:50153
I20240502 20:46:27.310482 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-a6521649137d4bab9ecf18c8f81abaed on tablet a6521649137d4bab9ecf18c8f81abaed with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:27.312469 18441 tablet_copy_client.cc:523] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.313712 18441 tablet_bootstrap.cc:492] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:27.335820 18441 tablet_bootstrap.cc:492] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.336158 18441 tablet_bootstrap.cc:492] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:27.336336 18441 ts_tablet_manager.cc:1367] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.023s user 0.022s sys 0.000s
I20240502 20:46:27.336827 18441 raft_consensus.cc:348] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.336941 18441 raft_consensus.cc:729] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:27.337023 18441 consensus_queue.cc:260] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.337270 18441 ts_tablet_manager.cc:1398] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:27.337754 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-8a392f6644c1465cada45ddddf4ee2c5 received from {username='slave'} at 127.9.82.135:58231
I20240502 20:46:27.337850 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-8a392f6644c1465cada45ddddf4ee2c5 on tablet 8a392f6644c1465cada45ddddf4ee2c5 with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:27.381305 18457 tablet_copy_client.cc:523] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.382866 18457 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:27.383141 17377 raft_consensus.cc:1203] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.394062 18462 tablet_copy_client.cc:523] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.395674 18462 tablet_bootstrap.cc:492] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:27.401495 18467 tablet_copy_client.cc:523] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.403265 18467 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:27.414535 18457 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.414680 17771 raft_consensus.cc:1203] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.415002 18457 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:27.415750 18472 tablet_copy_client.cc:523] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.415951 18457 ts_tablet_manager.cc:1367] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.033s user 0.023s sys 0.005s
I20240502 20:46:27.416388 18457 raft_consensus.cc:348] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.416519 18457 raft_consensus.cc:729] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:27.416612 18457 consensus_queue.cc:260] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.417048 18457 ts_tablet_manager.cc:1398] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:27.417230 18472 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:27.417586 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-effe8b25103e4fd6abafde8c7b425165 received from {username='slave'} at 127.9.82.133:46873
I20240502 20:46:27.417677 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-effe8b25103e4fd6abafde8c7b425165 on tablet effe8b25103e4fd6abafde8c7b425165 with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:27.426069 18462 tablet_bootstrap.cc:492] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.426309 18462 tablet_bootstrap.cc:492] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:27.426476 18462 ts_tablet_manager.cc:1367] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.031s user 0.023s sys 0.003s
I20240502 20:46:27.426925 18462 raft_consensus.cc:348] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.427042 18462 raft_consensus.cc:729] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:27.427160 18462 consensus_queue.cc:260] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.427464 18462 ts_tablet_manager.cc:1398] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:46:27.427953 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-15e0404ac2e44c36aa58c7b4c7705c11 received from {username='slave'} at 127.9.82.135:53037
I20240502 20:46:27.428053 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-15e0404ac2e44c36aa58c7b4c7705c11 on tablet 15e0404ac2e44c36aa58c7b4c7705c11 with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:27.442457 18477 tablet_copy_client.cc:523] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.444077 18477 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:27.451958 18472 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.452543 18472 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:27.452804 18472 ts_tablet_manager.cc:1367] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.036s user 0.029s sys 0.000s
I20240502 20:46:27.453426 18472 raft_consensus.cc:348] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.453655 18472 raft_consensus.cc:729] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:27.453812 18472 consensus_queue.cc:260] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.454224 18472 ts_tablet_manager.cc:1398] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:27.454699 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-86ff3421109a484f869fd29f63392186 received from {username='slave'} at 127.9.82.135:43011
I20240502 20:46:27.454788 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-86ff3421109a484f869fd29f63392186 on tablet 86ff3421109a484f869fd29f63392186 with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:27.457244 18467 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.457405 17509 raft_consensus.cc:1203] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.457626 18467 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:27.457825 18467 ts_tablet_manager.cc:1367] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.055s user 0.025s sys 0.004s
I20240502 20:46:27.458284 18467 raft_consensus.cc:348] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.458424 18467 raft_consensus.cc:729] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:27.458545 18467 consensus_queue.cc:260] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.459625 18467 ts_tablet_manager.cc:1398] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:27.460371 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-2436658a9dd54854a8920f9242068ee7 received from {username='slave'} at 127.9.82.133:49865
I20240502 20:46:27.460445 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-2436658a9dd54854a8920f9242068ee7 on tablet 2436658a9dd54854a8920f9242068ee7 with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:27.467336 17639 raft_consensus.cc:1203] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.468334 18483 tablet_copy_client.cc:523] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.469897 18483 tablet_bootstrap.cc:492] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:27.485105 18477 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.485395 18477 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:27.485569 18477 ts_tablet_manager.cc:1367] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.042s user 0.026s sys 0.004s
I20240502 20:46:27.485939 18477 raft_consensus.cc:348] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.486044 18477 raft_consensus.cc:729] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:27.486140 18477 consensus_queue.cc:260] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.486398 18477 ts_tablet_manager.cc:1398] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:27.486898 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-167efd92157a42ec84ea1cfb1de4a15c received from {username='slave'} at 127.9.82.136:35275
I20240502 20:46:27.486974 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 389fb867bde04f9980fe702dc1111079-167efd92157a42ec84ea1cfb1de4a15c on tablet 167efd92157a42ec84ea1cfb1de4a15c with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:27.496232 18483 tablet_bootstrap.cc:492] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.496558 18483 tablet_bootstrap.cc:492] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:27.496743 18483 ts_tablet_manager.cc:1367] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.027s user 0.021s sys 0.000s
I20240502 20:46:27.497867 18483 raft_consensus.cc:348] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:27.498008 18483 raft_consensus.cc:729] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:27.498106 18483 consensus_queue.cc:260] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:27.498392 18483 ts_tablet_manager.cc:1398] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:27.498996 15783 tablet_copy_service.cc:342] P 0dfebe1fc59a48debca946314a5e3d0a: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-f015e46a8a27436dbd88b97dd1798cb0 received from {username='slave'} at 127.9.82.134:38207
I20240502 20:46:27.499089 15783 tablet_copy_service.cc:433] P 0dfebe1fc59a48debca946314a5e3d0a: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-f015e46a8a27436dbd88b97dd1798cb0 on tablet f015e46a8a27436dbd88b97dd1798cb0 with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:27.531267 18523 tablet_copy_client.cc:523] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.532812 18523 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:27.536541 17771 raft_consensus.cc:1203] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.542748 17639 raft_consensus.cc:1203] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.553517 18523 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.553813 18523 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:27.553972 18523 ts_tablet_manager.cc:1367] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.021s user 0.020s sys 0.000s
I20240502 20:46:27.554350 18523 raft_consensus.cc:348] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.554471 18523 raft_consensus.cc:729] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:27.554550 18523 consensus_queue.cc:260] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:27.554800 18523 ts_tablet_manager.cc:1398] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:27.555395 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-60c7001f651848b788926cde86a3c0f6 received from {username='slave'} at 127.9.82.135:53037
I20240502 20:46:27.555495 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-60c7001f651848b788926cde86a3c0f6 on tablet 60c7001f651848b788926cde86a3c0f6 with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:27.571391 17509 raft_consensus.cc:1203] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.601502 17377 raft_consensus.cc:1203] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.602834 18079 raft_consensus.cc:1050] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:27.603267 18079 consensus_queue.cc:237] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:27.604736 15762 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.604764 15891 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.604820 17509 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.605211 18078 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.605520 19140 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.605687 18079 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.608000 18079 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.608551 15891 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.608942 17509 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.610904 15762 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.611497 15482 catalog_manager.cc:5484] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:27.615350 16025 consensus_queue.cc:237] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:27.616695 17509 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.616693 15891 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.617148 18079 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.617321 19140 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.618949 18078 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.619352 15891 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.620131 17509 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.621090 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1694de56984a4ca78f9dabaaca2677de with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:27.621709 15481 catalog_manager.cc:5484] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:27.624265 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 1694de56984a4ca78f9dabaaca2677de with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:27.624743 19148 tablet_replica.cc:330] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:27.625023 19148 raft_consensus.cc:2229] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:27.625231 19148 raft_consensus.cc:2258] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:27.626328 19148 ts_tablet_manager.cc:1875] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:27.627866 18596 tablet_copy_client.cc:523] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.628350 19148 ts_tablet_manager.cc:1888] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:27.628437 19148 log.cc:1196] T 1694de56984a4ca78f9dabaaca2677de P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/1694de56984a4ca78f9dabaaca2677de
I20240502 20:46:27.629050 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 1694de56984a4ca78f9dabaaca2677de (table rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]) successfully deleted
I20240502 20:46:27.629140 18596 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:27.642880 17771 raft_consensus.cc:1203] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.648129 18596 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.648396 18596 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:27.648587 18596 ts_tablet_manager.cc:1367] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.020s user 0.020s sys 0.000s
I20240502 20:46:27.648995 18596 raft_consensus.cc:348] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.649101 18596 raft_consensus.cc:729] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:27.649171 18596 consensus_queue.cc:260] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.649422 18596 ts_tablet_manager.cc:1398] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:27.649955 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-8a46ac0be3ab49e185c300eeedb8cd39 received from {username='slave'} at 127.9.82.136:58537
I20240502 20:46:27.650104 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 389fb867bde04f9980fe702dc1111079-8a46ac0be3ab49e185c300eeedb8cd39 on tablet 8a46ac0be3ab49e185c300eeedb8cd39 with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:27.654707 18696 tablet_copy_client.cc:523] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.656167 18696 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:27.677699 18696 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.678031 18696 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:27.678221 18696 ts_tablet_manager.cc:1367] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.022s user 0.020s sys 0.000s
I20240502 20:46:27.678629 18696 raft_consensus.cc:348] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.678742 18696 raft_consensus.cc:729] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:27.678851 18696 consensus_queue.cc:260] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:27.679124 18696 ts_tablet_manager.cc:1398] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:27.679735 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-15214db73de54afba83b983bc2865948 received from {username='slave'} at 127.9.82.133:49865
I20240502 20:46:27.679833 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-15214db73de54afba83b983bc2865948 on tablet 15214db73de54afba83b983bc2865948 with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:27.704034 17509 raft_consensus.cc:1203] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.708837 17377 raft_consensus.cc:1203] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.713838 18730 tablet_copy_client.cc:523] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:27.715417 18730 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:27.737653 18730 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:27.737967 18730 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:27.738152 18730 ts_tablet_manager.cc:1367] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.023s user 0.022s sys 0.000s
I20240502 20:46:27.738548 18730 raft_consensus.cc:348] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.738735 18730 raft_consensus.cc:729] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:27.738855 18730 consensus_queue.cc:260] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:27.739583 18730 ts_tablet_manager.cc:1398] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:46:27.740888 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-3e16f4c2f41e41eeb40b67b147296581 received from {username='slave'} at 127.9.82.136:58537
I20240502 20:46:27.740969 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 389fb867bde04f9980fe702dc1111079-3e16f4c2f41e41eeb40b67b147296581 on tablet 3e16f4c2f41e41eeb40b67b147296581 with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:27.770634 18078 raft_consensus.cc:1050] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:27.771127 18078 consensus_queue.cc:237] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:27.772637 15762 raft_consensus.cc:1261] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.772958 17377 raft_consensus.cc:1261] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.773119 15631 raft_consensus.cc:1261] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.773409 19140 consensus_queue.cc:1035] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.773602 18079 consensus_queue.cc:1035] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.773887 17013 consensus_queue.cc:1035] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.776780 19140 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:27.777113 17377 raft_consensus.cc:1203] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.778899 15762 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:27.779049 15631 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:27.779150 17378 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:27.781965 15483 catalog_manager.cc:5484] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:27.787053 16025 consensus_queue.cc:237] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:27.788739 15762 raft_consensus.cc:1261] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.788834 17378 raft_consensus.cc:1261] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.789240 18078 consensus_queue.cc:1035] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.789438 19140 consensus_queue.cc:1035] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.791190 19140 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:27.792132 15762 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:27.793072 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 360284c2b0c34339bbaeb5a20ee193ac with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:27.793401 17378 raft_consensus.cc:2932] T 360284c2b0c34339bbaeb5a20ee193ac P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:27.794148 15482 catalog_manager.cc:5484] T 360284c2b0c34339bbaeb5a20ee193ac P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:27.797677 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet 360284c2b0c34339bbaeb5a20ee193ac with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:27.798132 19241 tablet_replica.cc:330] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:27.798410 19241 raft_consensus.cc:2229] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:27.798619 19241 raft_consensus.cc:2258] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:27.800335 19241 ts_tablet_manager.cc:1875] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:27.802760 19241 ts_tablet_manager.cc:1888] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:27.802860 19241 log.cc:1196] T 360284c2b0c34339bbaeb5a20ee193ac P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/360284c2b0c34339bbaeb5a20ee193ac
I20240502 20:46:27.803537 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet 360284c2b0c34339bbaeb5a20ee193ac (table rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]) successfully deleted
I20240502 20:46:27.842051 18106 raft_consensus.cc:1050] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:27.842633 18106 consensus_queue.cc:237] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:27.844055 17509 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.844115 15762 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.844702 19279 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.844756 15891 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.845022 19277 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.845562 19277 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.848610 17771 raft_consensus.cc:1203] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.849431 19279 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.850585 15762 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.851999 17509 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.854496 18079 raft_consensus.cc:1050] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:27.854890 18079 consensus_queue.cc:237] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:27.856348 15762 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.856511 15893 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.856454 15891 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.856943 17771 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.857403 19140 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.857560 17013 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.857852 17013 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.859107 15482 catalog_manager.cc:5484] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 reported cstate change: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.862313 19140 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:27.863111 17771 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:27.864478 15894 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:27.864785 15763 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:27.867417 15484 catalog_manager.cc:5484] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 reported cstate change: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:27.869275 15631 consensus_queue.cc:237] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:27.870795 17509 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.871203 19055 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.873373 15763 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.873440 16025 consensus_queue.cc:237] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:27.873790 19055 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.874547 17378 raft_consensus.cc:1203] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.874636 19055 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.875298 15762 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.876127 17771 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.876605 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a6521649137d4bab9ecf18c8f81abaed with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:27.876574 19292 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.876786 18078 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.878424 17509 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.878597 18078 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:27.880769 17771 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:27.880551 15483 catalog_manager.cc:5484] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:27.881618 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:27.881929 15484 catalog_manager.cc:5484] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:27.883653 15762 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:27.884235 17639 raft_consensus.cc:1203] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.884910 15763 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:27.886641 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet a6521649137d4bab9ecf18c8f81abaed with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:27.887559 19299 tablet_replica.cc:330] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:27.887741 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:27.887931 19299 raft_consensus.cc:2229] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:27.888193 19299 raft_consensus.cc:2258] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:27.889815 19299 ts_tablet_manager.cc:1875] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:27.892406 19299 ts_tablet_manager.cc:1888] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:27.892515 19299 log.cc:1196] T a6521649137d4bab9ecf18c8f81abaed P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/a6521649137d4bab9ecf18c8f81abaed
I20240502 20:46:27.893121 19299 tablet_replica.cc:330] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:27.893301 19299 raft_consensus.cc:2229] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:27.893501 19299 raft_consensus.cc:2258] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:27.894204 19299 ts_tablet_manager.cc:1875] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:27.894197 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet a6521649137d4bab9ecf18c8f81abaed (table rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]) successfully deleted
I20240502 20:46:27.896184 19299 ts_tablet_manager.cc:1888] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:27.896322 19299 log.cc:1196] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/d1fcf1751e8f4b978ecbdb2535b7e1f1
I20240502 20:46:27.896891 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 (table rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]) successfully deleted
I20240502 20:46:27.947602 19277 raft_consensus.cc:1050] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:27.948138 19277 consensus_queue.cc:237] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:27.949826 15763 raft_consensus.cc:1261] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.949846 17639 raft_consensus.cc:1261] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.949836 15894 raft_consensus.cc:1261] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:27.950388 18106 consensus_queue.cc:1035] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.950575 19277 consensus_queue.cc:1035] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.950863 19055 consensus_queue.cc:1035] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:27.953887 19277 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:27.955678 15894 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:27.957046 15763 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:27.958246 17639 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:27.961337 15490 catalog_manager.cc:5484] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 reported cstate change: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:27.964807 15631 consensus_queue.cc:237] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:27.965955 17639 raft_consensus.cc:1261] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.966784 15894 raft_consensus.cc:1261] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:27.967239 18106 consensus_queue.cc:1035] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.967765 18106 consensus_queue.cc:1035] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:27.968966 19277 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:27.969393 17639 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:27.970541 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 15e0404ac2e44c36aa58c7b4c7705c11 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:27.971688 15894 raft_consensus.cc:2932] T 15e0404ac2e44c36aa58c7b4c7705c11 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:27.971792 15484 catalog_manager.cc:5484] T 15e0404ac2e44c36aa58c7b4c7705c11 P 47eb2a910e8949308b382a74c55030b5 reported cstate change: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:27.974987 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 15e0404ac2e44c36aa58c7b4c7705c11 with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:27.975294 19148 tablet_replica.cc:330] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:27.975438 19148 raft_consensus.cc:2229] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:27.975584 19148 raft_consensus.cc:2258] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:27.976392 19148 ts_tablet_manager.cc:1875] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:27.978535 19148 ts_tablet_manager.cc:1888] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:27.978590 19148 log.cc:1196] T 15e0404ac2e44c36aa58c7b4c7705c11 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/15e0404ac2e44c36aa58c7b4c7705c11
I20240502 20:46:27.979035 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 15e0404ac2e44c36aa58c7b4c7705c11 (table rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]) successfully deleted
I20240502 20:46:27.982865 16025 consensus_queue.cc:237] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:27.984385 15763 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:27.984390 15631 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:46:27.984776 15959 consensus_peers.cc:485] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 601b3ef7a0e34242a97210ff74c9e8b3. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:27.984849 19292 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:27.985060 18079 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:27.986940 18079 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:27.987434 15763 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:27.987912 15631 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:27.991533 15490 catalog_manager.cc:5484] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:27.996233 17639 raft_consensus.cc:1203] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:27.998622 18235 raft_consensus.cc:1050] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:27.999225 18235 consensus_queue.cc:237] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:28.000831 15631 raft_consensus.cc:1261] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.000847 16025 raft_consensus.cc:1261] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.001525 17639 raft_consensus.cc:1261] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.001246 19374 consensus_queue.cc:1035] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.001762 19298 consensus_queue.cc:1035] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.002039 19371 consensus_queue.cc:1035] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.004719 19374 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.005276 15631 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.005379 17639 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.005507 16024 consensus_queue.cc:237] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:28.007112 15894 raft_consensus.cc:1261] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.007706 15763 raft_consensus.cc:1261] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.007797 19292 consensus_queue.cc:1035] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.008191 19292 consensus_queue.cc:1035] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.008958 15490 catalog_manager.cc:5484] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.009702 16024 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
W20240502 20:46:28.010355 15960 consensus_peers.cc:485] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68458e99b8b345428f95c3ef410545a3. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:28.011214 19292 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:28.013417 15762 consensus_queue.cc:237] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:28.013432 15894 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:28.014536 15482 catalog_manager.cc:5484] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.016309 17639 raft_consensus.cc:1261] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.016578 15631 raft_consensus.cc:1261] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.016685 19371 consensus_queue.cc:1035] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.016909 18235 consensus_queue.cc:1035] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.018709 15762 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:28.019744 19371 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.020396 17639 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.021173 15475 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.021601 15631 raft_consensus.cc:2932] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.022972 15482 catalog_manager.cc:5484] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.024289 18756 raft_consensus.cc:1050] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:28.024708 18756 consensus_queue.cc:237] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:28.026304 16024 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.026389 17771 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.026439 15762 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.026830 18756 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.027062 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c0e045d15114b8ea88ff5ef05f3c1e4 with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:28.027221 18756 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.027465 18756 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.027606 19389 tablet_replica.cc:330] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:28.028255 19389 raft_consensus.cc:2229] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.028544 19389 raft_consensus.cc:2258] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.029763 19389 ts_tablet_manager.cc:1875] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.030696 19387 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.031100 16024 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.032032 15762 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.033656 15481 catalog_manager.cc:5484] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.034690 19389 ts_tablet_manager.cc:1888] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.034791 19389 log.cc:1196] T 4c0e045d15114b8ea88ff5ef05f3c1e4 P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/4c0e045d15114b8ea88ff5ef05f3c1e4
I20240502 20:46:28.035657 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet 4c0e045d15114b8ea88ff5ef05f3c1e4 (table rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]) successfully deleted
I20240502 20:46:28.037600 15894 consensus_queue.cc:237] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:28.038857 18106 raft_consensus.cc:1050] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:28.039278 18106 consensus_queue.cc:237] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:28.039426 17769 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.040110 19388 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.040545 17771 raft_consensus.cc:1203] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:28.040745 17770 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.041514 15762 raft_consensus.cc:1261] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.041630 16024 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.042328 19279 consensus_queue.cc:1035] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.042397 19388 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.043409 17378 raft_consensus.cc:1261] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.043958 16024 raft_consensus.cc:1261] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.044016 19055 consensus_queue.cc:1035] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.044559 19055 consensus_queue.cc:1035] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.047227 15762 consensus_queue.cc:237] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:28.047350 18106 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.048195 19388 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.049463 15763 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.049731 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 167efd92157a42ec84ea1cfb1de4a15c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.050670 16025 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.050848 15490 catalog_manager.cc:5484] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.052150 15481 catalog_manager.cc:5484] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.053159 15894 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.053189 17771 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.053929 19371 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.054088 16025 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.054198 16024 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.055189 19371 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.058523 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 167efd92157a42ec84ea1cfb1de4a15c with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:28.058774 19148 tablet_replica.cc:330] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:28.058921 19148 raft_consensus.cc:2229] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.059100 19148 raft_consensus.cc:2258] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.060083 19148 ts_tablet_manager.cc:1875] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.061753 17639 raft_consensus.cc:1203] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:28.062356 19148 ts_tablet_manager.cc:1888] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.062425 19148 log.cc:1196] T 167efd92157a42ec84ea1cfb1de4a15c P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/167efd92157a42ec84ea1cfb1de4a15c
I20240502 20:46:28.063570 17378 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.064091 19371 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.064908 15894 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.066347 15631 consensus_queue.cc:237] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:28.067003 16025 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.067164 19374 raft_consensus.cc:1050] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:28.067587 19374 consensus_queue.cc:237] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:28.067755 17378 raft_consensus.cc:1261] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.068169 19055 consensus_queue.cc:1035] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.069180 15762 raft_consensus.cc:1261] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.069242 17509 raft_consensus.cc:1261] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.069234 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 167efd92157a42ec84ea1cfb1de4a15c (table rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]) successfully deleted
I20240502 20:46:28.069645 19298 consensus_queue.cc:1035] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.069936 15894 raft_consensus.cc:1261] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.070577 16025 raft_consensus.cc:1261] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.070694 19055 consensus_queue.cc:1035] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.070914 18235 consensus_queue.cc:1035] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.071233 19298 consensus_queue.cc:1035] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.071774 15483 catalog_manager.cc:5484] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
W20240502 20:46:28.072180 15699 consensus_peers.cc:485] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 281af65f89524fdeba2c97322a482009. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:28.072486 19055 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.074433 15763 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.074674 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ef8149e90bfc405db47acd6d6fe576ad with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.075453 15484 catalog_manager.cc:5484] T ef8149e90bfc405db47acd6d6fe576ad P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.077042 17378 raft_consensus.cc:2932] T ef8149e90bfc405db47acd6d6fe576ad P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.078298 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet ef8149e90bfc405db47acd6d6fe576ad with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:28.078553 19389 tablet_replica.cc:330] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:28.078526 19371 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.078707 19389 raft_consensus.cc:2229] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.078871 19389 raft_consensus.cc:2258] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.079582 19389 ts_tablet_manager.cc:1875] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.080706 15894 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.080705 16025 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.081008 15490 catalog_manager.cc:5484] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.081851 19389 ts_tablet_manager.cc:1888] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.081918 19389 log.cc:1196] T ef8149e90bfc405db47acd6d6fe576ad P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/ef8149e90bfc405db47acd6d6fe576ad
I20240502 20:46:28.083527 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet ef8149e90bfc405db47acd6d6fe576ad (table rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]) successfully deleted
I20240502 20:46:28.087013 17509 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.089267 15763 consensus_queue.cc:237] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:28.090492 17509 raft_consensus.cc:1261] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.090505 16025 raft_consensus.cc:1261] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.090890 19371 consensus_queue.cc:1035] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.091395 19374 consensus_queue.cc:1035] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.093027 18235 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.094718 15475 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f015e46a8a27436dbd88b97dd1798cb0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.094817 17509 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.096400 15490 catalog_manager.cc:5484] T f015e46a8a27436dbd88b97dd1798cb0 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.098675 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet f015e46a8a27436dbd88b97dd1798cb0 with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:28.098919 19299 tablet_replica.cc:330] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:28.099059 19299 raft_consensus.cc:2229] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.099196 19299 raft_consensus.cc:2258] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.099915 19299 ts_tablet_manager.cc:1875] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.102285 19299 ts_tablet_manager.cc:1888] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.102346 19299 log.cc:1196] T f015e46a8a27436dbd88b97dd1798cb0 P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/f015e46a8a27436dbd88b97dd1798cb0
I20240502 20:46:28.105387 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet f015e46a8a27436dbd88b97dd1798cb0 (table rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]) successfully deleted
I20240502 20:46:28.105597 16025 raft_consensus.cc:2932] T f015e46a8a27436dbd88b97dd1798cb0 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.204561 19387 raft_consensus.cc:1050] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:28.205034 19387 consensus_queue.cc:237] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:28.206616 16025 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.206979 15631 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.207480 19371 raft_consensus.cc:1050] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:28.207500 18756 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.207919 19371 consensus_queue.cc:237] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:28.208084 17509 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.208407 18756 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.208742 18756 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.209326 15632 raft_consensus.cc:1261] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.210049 15894 raft_consensus.cc:1261] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.210127 19298 consensus_queue.cc:1035] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.210830 17771 raft_consensus.cc:1261] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.211078 19298 consensus_queue.cc:1035] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.213573 18235 consensus_queue.cc:1035] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.216020 18756 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.216223 19298 raft_consensus.cc:2932] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.218101 15631 raft_consensus.cc:2932] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.218132 15632 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.219151 15490 catalog_manager.cc:5484] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.220301 16025 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.222615 17771 raft_consensus.cc:2932] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.222905 15483 catalog_manager.cc:5484] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.226431 17509 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.228250 15763 consensus_queue.cc:237] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:28.230158 15632 raft_consensus.cc:1261] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.230163 17771 raft_consensus.cc:1261] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.231856 15891 consensus_queue.cc:237] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:28.231899 19374 consensus_queue.cc:1035] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.232144 19374 consensus_queue.cc:1035] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.233053 15631 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.233440 19388 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.234110 17509 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.234766 19374 raft_consensus.cc:2932] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.235256 19387 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.235757 17174 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.236163 15632 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.237232 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ce9c2a00fa6b43938a7eb89a82bae6ce with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.237632 15475 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1abc3674e948410296824189a95ae253 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.238165 15632 raft_consensus.cc:2932] T 1abc3674e948410296824189a95ae253 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.239441 15490 catalog_manager.cc:5484] T 1abc3674e948410296824189a95ae253 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.240518 15481 catalog_manager.cc:5484] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.241498 17509 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:28.242691 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet 1abc3674e948410296824189a95ae253 with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:28.242883 19299 tablet_replica.cc:330] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:28.243041 19299 raft_consensus.cc:2229] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.243222 19299 pending_rounds.cc:62] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: Trying to abort 1 pending ops.
I20240502 20:46:28.243208 17771 raft_consensus.cc:2932] T 1abc3674e948410296824189a95ae253 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.243307 19299 pending_rounds.cc:68] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: Aborting op as it isn't in flight: id { term: 1 index: 5 } timestamp: 7023340700498350080 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "1abc3674e948410296824189a95ae253" old_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } } new_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } } }
I20240502 20:46:28.243454 19299 raft_consensus.cc:2894] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Aborting config change with OpId 1.5: Aborted: Op aborted
I20240502 20:46:28.243520 19299 raft_consensus.cc:2866] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240502 20:46:28.243570 19299 raft_consensus.cc:2258] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.244494 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet ce9c2a00fa6b43938a7eb89a82bae6ce with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:28.244730 19389 tablet_replica.cc:330] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:28.244733 19299 ts_tablet_manager.cc:1875] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.244851 19389 raft_consensus.cc:2229] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.244998 19389 raft_consensus.cc:2258] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.245980 19389 ts_tablet_manager.cc:1875] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.246956 19299 ts_tablet_manager.cc:1888] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.247035 19299 log.cc:1196] T 1abc3674e948410296824189a95ae253 P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/1abc3674e948410296824189a95ae253
I20240502 20:46:28.247960 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet 1abc3674e948410296824189a95ae253 (table rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]) successfully deleted
I20240502 20:46:28.248077 19389 ts_tablet_manager.cc:1888] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.248153 19389 log.cc:1196] T ce9c2a00fa6b43938a7eb89a82bae6ce P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/ce9c2a00fa6b43938a7eb89a82bae6ce
I20240502 20:46:28.248663 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet ce9c2a00fa6b43938a7eb89a82bae6ce (table rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]) successfully deleted
I20240502 20:46:28.250308 15632 consensus_queue.cc:237] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:28.251657 15763 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.251703 15891 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.252102 19277 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 20:46:28.252311 15567 consensus_peers.cc:485] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75f842e898b845f69b2617cc539b00db. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:28.252323 18106 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.254129 19279 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:28.254596 15763 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:28.254712 15891 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:28.257359 15481 catalog_manager.cc:5484] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:28.258999 19140 raft_consensus.cc:1050] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:28.259408 19140 consensus_queue.cc:237] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:28.261193 17378 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.261238 15632 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.261641 18079 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.261765 15891 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.262151 18079 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.262645 18078 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.265199 18079 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.265628 17378 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.267627 15891 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.268098 15632 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.268239 15490 catalog_manager.cc:5484] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.270773 18079 raft_consensus.cc:1050] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:28.271204 18079 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:28.272617 17378 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.273039 15632 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.273039 15763 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.273330 19140 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.273468 18079 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.274112 19140 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.274132 15632 consensus_queue.cc:237] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:28.275194 16025 consensus_queue.cc:237] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:28.276285 17377 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.276340 15891 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.276908 19140 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.277297 15762 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:46:28.277428 15568 consensus_peers.cc:485] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5981b9676cb4abab938aeaf7fe52c3d. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:28.277812 19279 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.277954 17377 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.276894 18079 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20240502 20:46:28.279197 19140 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.280062 16025 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.280061 15763 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.280601 18106 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.280447 19279 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.281755 16025 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.282301 15632 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.282407 18078 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.282445 15490 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.284215 15894 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.285964 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 15214db73de54afba83b983bc2865948 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.286592 17377 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.287302 15482 catalog_manager.cc:5484] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.289907 15763 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.290247 15484 catalog_manager.cc:5484] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.293844 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet 15214db73de54afba83b983bc2865948 with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:28.294113 19241 tablet_replica.cc:330] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:28.294262 19241 raft_consensus.cc:2229] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.294426 19241 raft_consensus.cc:2258] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.295013 16025 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:28.295163 19241 ts_tablet_manager.cc:1875] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.296370 15763 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.296830 18079 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.297267 17377 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.297546 19241 ts_tablet_manager.cc:1888] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.297623 19241 log.cc:1196] T 15214db73de54afba83b983bc2865948 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/15214db73de54afba83b983bc2865948
I20240502 20:46:28.297911 18079 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.298346 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet 15214db73de54afba83b983bc2865948 (table rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]) successfully deleted
I20240502 20:46:28.298717 18079 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.299980 17377 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.300640 15763 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.302042 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2436658a9dd54854a8920f9242068ee7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.303104 15482 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f reported cstate change: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.305887 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet 2436658a9dd54854a8920f9242068ee7 with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:28.306181 19241 tablet_replica.cc:330] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:28.306324 19241 raft_consensus.cc:2229] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.306443 19241 raft_consensus.cc:2258] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.307175 19241 ts_tablet_manager.cc:1875] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.309450 19241 ts_tablet_manager.cc:1888] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.309520 19241 log.cc:1196] T 2436658a9dd54854a8920f9242068ee7 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/2436658a9dd54854a8920f9242068ee7
I20240502 20:46:28.310027 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet 2436658a9dd54854a8920f9242068ee7 (table rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]) successfully deleted
I20240502 20:46:28.348424 19277 raft_consensus.cc:1050] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:28.348855 19277 consensus_queue.cc:237] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:28.351500 15763 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.351959 18106 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.352275 15891 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.352691 17771 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.352918 18106 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.353109 19055 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.355289 19055 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.355891 15891 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.355930 17771 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.358429 15481 catalog_manager.cc:5484] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 reported cstate change: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.359215 15763 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.360695 18079 raft_consensus.cc:1050] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:28.361081 18079 consensus_queue.cc:237] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:28.362439 15632 raft_consensus.cc:1261] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.362818 19292 consensus_queue.cc:1035] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.364041 15763 raft_consensus.cc:1261] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.364425 17639 raft_consensus.cc:1261] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.364461 18078 consensus_queue.cc:1035] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.364940 18078 consensus_queue.cc:1035] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.366775 19292 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.367296 17639 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.367458 15632 consensus_queue.cc:237] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:28.367892 15762 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.369110 15891 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.369099 15632 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.369565 18106 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.370028 17771 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.370414 15483 catalog_manager.cc:5484] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.371273 19279 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.372179 19277 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.372490 15891 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.373601 17771 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.375327 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8a46ac0be3ab49e185c300eeedb8cd39 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.375861 15481 catalog_manager.cc:5484] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.376279 16025 consensus_queue.cc:237] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:28.377930 15763 raft_consensus.cc:1261] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.378849 17639 raft_consensus.cc:1261] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.379236 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a46ac0be3ab49e185c300eeedb8cd39 with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:28.379282 18078 consensus_queue.cc:1035] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.379495 19148 tablet_replica.cc:330] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:28.379479 19140 consensus_queue.cc:1035] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.379631 19148 raft_consensus.cc:2229] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.379824 19148 raft_consensus.cc:2258] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.380852 19148 ts_tablet_manager.cc:1875] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.381254 19140 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.381615 15763 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.383222 19148 ts_tablet_manager.cc:1888] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.383289 19148 log.cc:1196] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/8a46ac0be3ab49e185c300eeedb8cd39
I20240502 20:46:28.383639 15483 catalog_manager.cc:5484] T 8a392f6644c1465cada45ddddf4ee2c5 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.383847 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 8a46ac0be3ab49e185c300eeedb8cd39 (table rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]) successfully deleted
I20240502 20:46:28.384006 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8a392f6644c1465cada45ddddf4ee2c5 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.386695 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a392f6644c1465cada45ddddf4ee2c5 with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:28.387179 19241 tablet_replica.cc:330] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:28.387334 19241 raft_consensus.cc:2229] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.387493 19241 raft_consensus.cc:2258] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.388159 18106 raft_consensus.cc:1050] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:28.388563 18106 consensus_queue.cc:237] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:28.389639 19241 ts_tablet_manager.cc:1875] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.389953 17377 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.390064 16025 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.390349 19279 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.390828 19279 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.390766 17639 raft_consensus.cc:2932] T 8a392f6644c1465cada45ddddf4ee2c5 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.391917 19241 ts_tablet_manager.cc:1888] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.391996 19241 log.cc:1196] T 8a392f6644c1465cada45ddddf4ee2c5 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/8a392f6644c1465cada45ddddf4ee2c5
I20240502 20:46:28.392388 15891 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.392846 19279 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.394448 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet 8a392f6644c1465cada45ddddf4ee2c5 (table rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]) successfully deleted
I20240502 20:46:28.395560 19279 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.395978 15891 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.398483 16025 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.398911 19277 raft_consensus.cc:1050] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:28.399300 19277 consensus_queue.cc:237] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:28.399367 17377 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.400998 17639 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.401042 15763 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.401463 19055 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.401806 19055 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.401876 15891 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.402617 15483 catalog_manager.cc:5484] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.402874 18106 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.405787 19279 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.407572 15891 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.408345 15762 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.410249 17639 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.411372 15482 catalog_manager.cc:5484] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.415796 15631 consensus_queue.cc:237] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:28.415761 15632 consensus_queue.cc:237] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:28.416843 15762 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.417122 17639 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.417395 17377 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.417802 15891 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.417814 18106 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.418023 19055 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.418869 18106 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.419027 19055 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.419705 19277 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.420091 17377 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.421236 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet effe8b25103e4fd6abafde8c7b425165 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.421280 15891 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.422420 15484 catalog_manager.cc:5484] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f reported cstate change: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:28.423169 19055 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.424782 17639 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.425362 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet effe8b25103e4fd6abafde8c7b425165 with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:28.425577 19389 tablet_replica.cc:330] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:28.425712 19389 raft_consensus.cc:2229] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.425881 19389 raft_consensus.cc:2258] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.426192 15762 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.427538 15490 catalog_manager.cc:5484] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 reported cstate change: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.428454 19389 ts_tablet_manager.cc:1875] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.430450 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c7001f651848b788926cde86a3c0f6 with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:28.430683 19299 tablet_replica.cc:330] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:28.430727 19389 ts_tablet_manager.cc:1888] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.430799 19389 log.cc:1196] T effe8b25103e4fd6abafde8c7b425165 P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/effe8b25103e4fd6abafde8c7b425165
I20240502 20:46:28.430835 19299 raft_consensus.cc:2229] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.430972 19299 raft_consensus.cc:2258] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.431453 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet effe8b25103e4fd6abafde8c7b425165 (table rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]) successfully deleted
I20240502 20:46:28.431613 19299 ts_tablet_manager.cc:1875] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.431816 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 60c7001f651848b788926cde86a3c0f6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.433782 19299 ts_tablet_manager.cc:1888] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.433835 19299 log.cc:1196] T 60c7001f651848b788926cde86a3c0f6 P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/60c7001f651848b788926cde86a3c0f6
I20240502 20:46:28.434295 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet 60c7001f651848b788926cde86a3c0f6 (table rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]) successfully deleted
I20240502 20:46:28.446801 16025 consensus_queue.cc:237] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:28.448244 15891 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.448415 15632 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:46:28.448750 15959 consensus_peers.cc:485] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7460cf8211d24a3d97085d1a36116a29. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:28.448791 19292 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.448983 18079 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.450729 17013 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:28.451155 15891 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:28.453326 15632 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:28.453855 15481 catalog_manager.cc:5484] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index -1 to 4, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.457790 19387 raft_consensus.cc:1050] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:28.458235 19387 consensus_queue.cc:237] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:28.459673 17639 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.459959 16024 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.460492 19387 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.461150 19387 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.461601 15632 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.462052 19387 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.463758 19388 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.464226 16024 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.465696 17639 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.466599 15490 catalog_manager.cc:5484] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.467330 15630 consensus_queue.cc:237] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:28.468827 15762 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.468884 15631 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
W20240502 20:46:28.469023 15568 consensus_peers.cc:485] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1eb03dc9cdf04f7a9ef9b96da66ab7dc. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:28.469347 15891 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.469388 19279 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.469780 19279 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.471058 15894 consensus_queue.cc:237] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:28.472235 17639 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.472600 17174 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.473137 19055 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.473541 15891 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.474184 16024 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.474630 19388 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.475045 17639 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.475903 15762 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.474633 17174 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20240502 20:46:28.476972 15490 catalog_manager.cc:5484] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.477401 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 86ff3421109a484f869fd29f63392186 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.478217 16024 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.479981 15481 catalog_manager.cc:5484] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 reported cstate change: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:28.483547 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet 86ff3421109a484f869fd29f63392186 with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:28.483830 19241 tablet_replica.cc:330] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:28.483978 19241 raft_consensus.cc:2229] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.484133 19241 raft_consensus.cc:2258] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.484858 19241 ts_tablet_manager.cc:1875] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.486989 19241 ts_tablet_manager.cc:1888] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.487085 19241 log.cc:1196] T 86ff3421109a484f869fd29f63392186 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/86ff3421109a484f869fd29f63392186
I20240502 20:46:28.487602 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet 86ff3421109a484f869fd29f63392186 (table rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]) successfully deleted
I20240502 20:46:28.489787 15891 consensus_queue.cc:237] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
W20240502 20:46:28.491477 15829 consensus_peers.cc:485] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 702e67697b514f7fb3975d56c253d918. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:28.491499 15632 raft_consensus.cc:1261] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.491900 15762 raft_consensus.cc:1261] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.492293 17174 consensus_queue.cc:1035] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.492745 19387 consensus_queue.cc:1035] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.494022 18756 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:28.494575 15762 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:28.496012 15632 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:28.497179 15490 catalog_manager.cc:5484] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.498045 19277 raft_consensus.cc:1050] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:28.498394 19277 consensus_queue.cc:237] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:28.499815 17771 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.499840 16024 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.500548 18106 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.500834 19277 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.500898 15891 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:28.502076 19277 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:28.510790 15891 consensus_queue.cc:237] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:28.512557 16024 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.512854 19277 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.513437 19388 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.514623 15632 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.514945 19388 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.515704 16025 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.516176 15481 catalog_manager.cc:5484] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.517426 15894 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
W20240502 20:46:28.520188 15830 consensus_peers.cc:485] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a87847912eaa4602abf9bd9cf2c698fd. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:28.521337 17771 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.521881 19387 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.523226 15631 consensus_queue.cc:237] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:28.524709 15891 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.524682 17771 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:28.525171 19055 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.525439 19055 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:28.525700 15632 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.525866 15490 catalog_manager.cc:5484] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.528568 19660 ts_tablet_manager.cc:902] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:28.528734 19055 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.529670 19660 tablet_copy_client.cc:308] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:28.530395 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 601b3ef7a0e34242a97210ff74c9e8b3 from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:35909)
I20240502 20:46:28.530491 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 601b3ef7a0e34242a97210ff74c9e8b3 from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:35909: session id = 376b7736472c4bf2836c4303abf8e6c3-601b3ef7a0e34242a97210ff74c9e8b3
I20240502 20:46:28.530692 17771 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.531394 16045 tablet_copy_source_session.cc:205] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:28.532009 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 3e16f4c2f41e41eeb40b67b147296581 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:28.532449 15891 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:28.526307 16024 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.536962 15490 catalog_manager.cc:5484] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:28.538697 19660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601b3ef7a0e34242a97210ff74c9e8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:28.541280 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e16f4c2f41e41eeb40b67b147296581 with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:28.541479 19389 tablet_replica.cc:330] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:28.541635 19389 raft_consensus.cc:2229] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:28.541802 19389 raft_consensus.cc:2258] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:28.542244 19660 tablet_copy_client.cc:783] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:28.542398 19660 tablet_copy_client.cc:647] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:28.542598 19389 ts_tablet_manager.cc:1875] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:28.543855 19664 tablet_copy_client.cc:1002] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:28.545233 19389 ts_tablet_manager.cc:1888] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:28.545285 19389 log.cc:1196] T 3e16f4c2f41e41eeb40b67b147296581 P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/3e16f4c2f41e41eeb40b67b147296581
I20240502 20:46:28.545827 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet 3e16f4c2f41e41eeb40b67b147296581 (table rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]) successfully deleted
I20240502 20:46:28.546799 19670 ts_tablet_manager.cc:902] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:28.547945 19670 tablet_copy_client.cc:308] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:28.548415 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 68458e99b8b345428f95c3ef410545a3 from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:38827)
I20240502 20:46:28.548511 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 68458e99b8b345428f95c3ef410545a3 from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:38827: session id = 389fb867bde04f9980fe702dc1111079-68458e99b8b345428f95c3ef410545a3
I20240502 20:46:28.548858 19675 ts_tablet_manager.cc:902] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:28.549347 16045 tablet_copy_source_session.cc:205] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:28.550244 19675 tablet_copy_client.cc:308] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:32937
I20240502 20:46:28.550675 19670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68458e99b8b345428f95c3ef410545a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:28.552874 19670 tablet_copy_client.cc:783] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:28.553045 19670 tablet_copy_client.cc:647] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:28.554188 19671 tablet_copy_client.cc:1002] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:28.556768 15783 tablet_copy_service.cc:140] P 0dfebe1fc59a48debca946314a5e3d0a: Received BeginTabletCopySession request for tablet 281af65f89524fdeba2c97322a482009 from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:33861)
I20240502 20:46:28.556885 15783 tablet_copy_service.cc:161] P 0dfebe1fc59a48debca946314a5e3d0a: Beginning new tablet copy session on tablet 281af65f89524fdeba2c97322a482009 from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:33861: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-281af65f89524fdeba2c97322a482009
I20240502 20:46:28.557715 15783 tablet_copy_source_session.cc:205] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:28.558609 19675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281af65f89524fdeba2c97322a482009. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:28.560668 19675 tablet_copy_client.cc:783] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:28.560825 19675 tablet_copy_client.cc:647] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:28.561872 19678 tablet_copy_client.cc:1002] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:28.636978 16024 consensus_queue.cc:237] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:28.638593 15762 raft_consensus.cc:1261] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:46:28.638661 15961 consensus_peers.cc:485] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d61acdada50a42ba96d4844e64dba6a7. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:28.638996 15891 raft_consensus.cc:1261] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:28.639042 19140 consensus_queue.cc:1035] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.639413 19140 consensus_queue.cc:1035] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:28.641000 17013 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.641412 15762 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.641801 15891 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:28.644084 15490 catalog_manager.cc:5484] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:28.693939 19784 ts_tablet_manager.cc:902] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:28.694510 19784 tablet_copy_client.cc:308] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:28.695096 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 75f842e898b845f69b2617cc539b00db from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:53037)
I20240502 20:46:28.695206 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 75f842e898b845f69b2617cc539b00db from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:53037: session id = 47eb2a910e8949308b382a74c55030b5-75f842e898b845f69b2617cc539b00db
I20240502 20:46:28.696149 15652 tablet_copy_source_session.cc:205] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:28.696993 19784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f842e898b845f69b2617cc539b00db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:28.699715 19784 tablet_copy_client.cc:783] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:28.699968 19784 tablet_copy_client.cc:647] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:28.701023 19786 tablet_copy_client.cc:1002] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:28.851902 19804 ts_tablet_manager.cc:902] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:28.852367 19804 tablet_copy_client.cc:308] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:28.852819 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 7460cf8211d24a3d97085d1a36116a29 from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:35909)
I20240502 20:46:28.852946 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 7460cf8211d24a3d97085d1a36116a29 from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:35909: session id = 376b7736472c4bf2836c4303abf8e6c3-7460cf8211d24a3d97085d1a36116a29
I20240502 20:46:28.853678 16045 tablet_copy_source_session.cc:205] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:28.854460 19809 ts_tablet_manager.cc:902] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:28.854619 19804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7460cf8211d24a3d97085d1a36116a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:28.855008 19809 tablet_copy_client.cc:308] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:28.855507 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet b5981b9676cb4abab938aeaf7fe52c3d from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:46873)
I20240502 20:46:28.855607 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet b5981b9676cb4abab938aeaf7fe52c3d from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:46873: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-b5981b9676cb4abab938aeaf7fe52c3d
I20240502 20:46:28.856379 15652 tablet_copy_source_session.cc:205] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:28.856678 19804 tablet_copy_client.cc:783] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:28.856885 19804 tablet_copy_client.cc:647] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:28.856951 19814 ts_tablet_manager.cc:902] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:28.857328 19809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5981b9676cb4abab938aeaf7fe52c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:28.857892 19808 tablet_copy_client.cc:1002] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:28.858011 19814 tablet_copy_client.cc:308] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:28.858448 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:46873)
I20240502 20:46:28.858542 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:46873: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-1eb03dc9cdf04f7a9ef9b96da66ab7dc
I20240502 20:46:28.859140 15652 tablet_copy_source_session.cc:205] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:28.859287 19809 tablet_copy_client.cc:783] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:28.859458 19809 tablet_copy_client.cc:647] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:28.859946 19814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:28.860350 19813 tablet_copy_client.cc:1002] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:28.861441 19814 tablet_copy_client.cc:783] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:28.861569 19814 tablet_copy_client.cc:647] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:28.862600 19818 tablet_copy_client.cc:1002] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:28.912330 19819 ts_tablet_manager.cc:902] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:28.912889 19819 tablet_copy_client.cc:308] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:28.913388 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet 702e67697b514f7fb3975d56c253d918 from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:35275)
I20240502 20:46:28.913506 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet 702e67697b514f7fb3975d56c253d918 from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:35275: session id = 389fb867bde04f9980fe702dc1111079-702e67697b514f7fb3975d56c253d918
I20240502 20:46:28.914443 15914 tablet_copy_source_session.cc:205] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:28.915256 19819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 702e67697b514f7fb3975d56c253d918. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:28.916961 19819 tablet_copy_client.cc:783] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:28.917104 19819 tablet_copy_client.cc:647] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:28.918031 19823 tablet_copy_client.cc:1002] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:28.959475 19854 ts_tablet_manager.cc:902] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:28.960582 19854 tablet_copy_client.cc:308] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:28.964391 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet a87847912eaa4602abf9bd9cf2c698fd from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:43731)
I20240502 20:46:28.964485 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet a87847912eaa4602abf9bd9cf2c698fd from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:43731: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-a87847912eaa4602abf9bd9cf2c698fd
I20240502 20:46:28.965180 15914 tablet_copy_source_session.cc:205] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:28.966192 19854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87847912eaa4602abf9bd9cf2c698fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:28.968379 19854 tablet_copy_client.cc:783] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:28.968552 19854 tablet_copy_client.cc:647] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:28.969533 19862 tablet_copy_client.cc:1002] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:29.180148 19883 ts_tablet_manager.cc:902] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:29.180721 19883 tablet_copy_client.cc:308] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:29.181282 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet d61acdada50a42ba96d4844e64dba6a7 from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:49865)
I20240502 20:46:29.181399 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet d61acdada50a42ba96d4844e64dba6a7 from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:49865: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-d61acdada50a42ba96d4844e64dba6a7
I20240502 20:46:29.182271 16045 tablet_copy_source_session.cc:205] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:29.183079 19883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d61acdada50a42ba96d4844e64dba6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:29.185395 19883 tablet_copy_client.cc:783] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:29.185549 19883 tablet_copy_client.cc:647] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:29.186735 19887 tablet_copy_client.cc:1002] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:30.044165 19660 tablet_copy_client.cc:523] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.045485 19660 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:30.054517 19670 tablet_copy_client.cc:523] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.056095 19670 tablet_bootstrap.cc:492] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:30.062203 19675 tablet_copy_client.cc:523] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.063689 19675 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:30.064566 19660 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.064812 19660 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:30.064985 19660 ts_tablet_manager.cc:1367] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.011s
I20240502 20:46:30.065372 19660 raft_consensus.cc:348] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:30.065481 19660 raft_consensus.cc:729] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:30.065590 19660 consensus_queue.cc:260] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:30.065984 19660 ts_tablet_manager.cc:1398] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:46:30.066617 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-601b3ef7a0e34242a97210ff74c9e8b3 received from {username='slave'} at 127.9.82.134:35909
I20240502 20:46:30.066709 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-601b3ef7a0e34242a97210ff74c9e8b3 on tablet 601b3ef7a0e34242a97210ff74c9e8b3 with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:30.077172 19670 tablet_bootstrap.cc:492] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.077461 19670 tablet_bootstrap.cc:492] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:30.077642 19670 ts_tablet_manager.cc:1367] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.022s user 0.018s sys 0.002s
I20240502 20:46:30.078022 19670 raft_consensus.cc:348] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:30.078130 19670 raft_consensus.cc:729] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:30.078226 19670 consensus_queue.cc:260] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:30.078522 19670 ts_tablet_manager.cc:1398] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:46:30.079052 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-68458e99b8b345428f95c3ef410545a3 received from {username='slave'} at 127.9.82.136:38827
I20240502 20:46:30.079144 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 389fb867bde04f9980fe702dc1111079-68458e99b8b345428f95c3ef410545a3 on tablet 68458e99b8b345428f95c3ef410545a3 with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:30.083665 19675 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.084023 19675 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:30.084226 19675 ts_tablet_manager.cc:1367] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.007s
I20240502 20:46:30.084589 19675 raft_consensus.cc:348] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.084688 19675 raft_consensus.cc:729] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:30.084772 19675 consensus_queue.cc:260] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.085062 19675 ts_tablet_manager.cc:1398] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:30.085611 15783 tablet_copy_service.cc:342] P 0dfebe1fc59a48debca946314a5e3d0a: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-281af65f89524fdeba2c97322a482009 received from {username='slave'} at 127.9.82.133:33861
I20240502 20:46:30.085692 15783 tablet_copy_service.cc:433] P 0dfebe1fc59a48debca946314a5e3d0a: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-281af65f89524fdeba2c97322a482009 on tablet 281af65f89524fdeba2c97322a482009 with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:30.189304 17377 raft_consensus.cc:1203] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.201334 19784 tablet_copy_client.cc:523] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.202715 19784 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:30.223891 19784 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.224210 19784 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:30.224404 19784 ts_tablet_manager.cc:1367] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.022s user 0.022s sys 0.000s
I20240502 20:46:30.224841 19784 raft_consensus.cc:348] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:30.224953 19784 raft_consensus.cc:729] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:30.225049 19784 consensus_queue.cc:260] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:30.225392 19784 ts_tablet_manager.cc:1398] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:30.225925 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-75f842e898b845f69b2617cc539b00db received from {username='slave'} at 127.9.82.135:53037
I20240502 20:46:30.226052 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-75f842e898b845f69b2617cc539b00db on tablet 75f842e898b845f69b2617cc539b00db with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:30.316884 17639 raft_consensus.cc:1203] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.319377 17771 raft_consensus.cc:1203] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.358230 19804 tablet_copy_client.cc:523] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.359783 19804 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:30.360695 19809 tablet_copy_client.cc:523] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.362246 19809 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:30.362896 19814 tablet_copy_client.cc:523] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.364151 19814 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:30.382923 19814 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.383220 19814 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:30.383406 19814 ts_tablet_manager.cc:1367] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.002s
I20240502 20:46:30.383848 19814 raft_consensus.cc:348] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.383960 19814 raft_consensus.cc:729] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:30.384079 19814 consensus_queue.cc:260] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.384464 19814 ts_tablet_manager.cc:1398] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:46:30.385119 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-1eb03dc9cdf04f7a9ef9b96da66ab7dc received from {username='slave'} at 127.9.82.133:46873
I20240502 20:46:30.385217 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-1eb03dc9cdf04f7a9ef9b96da66ab7dc on tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:30.387990 19804 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.388407 19804 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:30.388443 19809 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.388691 19809 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:30.388693 19804 ts_tablet_manager.cc:1367] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.029s user 0.029s sys 0.000s
I20240502 20:46:30.388854 19809 ts_tablet_manager.cc:1367] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.027s user 0.026s sys 0.000s
I20240502 20:46:30.389171 19804 raft_consensus.cc:348] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:30.389254 19809 raft_consensus.cc:348] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.389317 19804 raft_consensus.cc:729] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:30.389354 19809 raft_consensus.cc:729] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:30.389428 19804 consensus_queue.cc:260] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:30.389451 19809 consensus_queue.cc:260] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.389796 19804 ts_tablet_manager.cc:1398] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:46:30.389796 19809 ts_tablet_manager.cc:1398] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:46:30.390388 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-7460cf8211d24a3d97085d1a36116a29 received from {username='slave'} at 127.9.82.134:35909
I20240502 20:46:30.390489 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-7460cf8211d24a3d97085d1a36116a29 on tablet 7460cf8211d24a3d97085d1a36116a29 with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:30.390461 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-b5981b9676cb4abab938aeaf7fe52c3d received from {username='slave'} at 127.9.82.133:46873
I20240502 20:46:30.390584 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-b5981b9676cb4abab938aeaf7fe52c3d on tablet b5981b9676cb4abab938aeaf7fe52c3d with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:30.400056 17377 raft_consensus.cc:1203] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.418408 19819 tablet_copy_client.cc:523] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.420017 19819 tablet_bootstrap.cc:492] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:30.439532 19819 tablet_bootstrap.cc:492] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.439879 19819 tablet_bootstrap.cc:492] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:30.440100 19819 ts_tablet_manager.cc:1367] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.003s
I20240502 20:46:30.440542 19819 raft_consensus.cc:348] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:30.440676 19819 raft_consensus.cc:729] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:30.440799 19819 consensus_queue.cc:260] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:30.441107 19819 ts_tablet_manager.cc:1398] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:30.441687 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-702e67697b514f7fb3975d56c253d918 received from {username='slave'} at 127.9.82.136:35275
I20240502 20:46:30.441772 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 389fb867bde04f9980fe702dc1111079-702e67697b514f7fb3975d56c253d918 on tablet 702e67697b514f7fb3975d56c253d918 with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:30.469861 19854 tablet_copy_client.cc:523] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.471225 19854 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:30.489773 19854 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.490108 19854 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:30.490324 19854 ts_tablet_manager.cc:1367] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.004s
I20240502 20:46:30.490736 19854 raft_consensus.cc:348] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.490875 19854 raft_consensus.cc:729] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:30.490981 19854 consensus_queue.cc:260] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.491261 19854 ts_tablet_manager.cc:1398] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:30.491916 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-a87847912eaa4602abf9bd9cf2c698fd received from {username='slave'} at 127.9.82.133:43731
I20240502 20:46:30.492023 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-a87847912eaa4602abf9bd9cf2c698fd on tablet a87847912eaa4602abf9bd9cf2c698fd with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:30.505084 17509 raft_consensus.cc:1203] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.587040 20206 raft_consensus.cc:1050] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:30.587440 20206 consensus_queue.cc:237] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:30.588819 17377 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.588907 15891 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.588963 16024 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.589427 20205 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.589612 20206 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.589764 20208 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.591851 20206 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.592432 17377 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.592684 16024 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.594079 15891 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.595118 15481 catalog_manager.cc:5484] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.599045 15762 consensus_queue.cc:237] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:30.600109 17377 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:30.600208 16024 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:30.600497 19990 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:30.600666 20208 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:30.602221 20208 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.602732 17377 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.604488 15475 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 281af65f89524fdeba2c97322a482009 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:30.604849 15490 catalog_manager.cc:5484] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:30.605582 16024 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.607304 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet 281af65f89524fdeba2c97322a482009 with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:30.607749 20216 tablet_replica.cc:330] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:30.607924 20216 raft_consensus.cc:2229] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:30.608124 20216 raft_consensus.cc:2258] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:30.609025 20216 ts_tablet_manager.cc:1875] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:30.610978 20216 ts_tablet_manager.cc:1888] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:30.611058 20216 log.cc:1196] T 281af65f89524fdeba2c97322a482009 P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/281af65f89524fdeba2c97322a482009
I20240502 20:46:30.611639 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet 281af65f89524fdeba2c97322a482009 (table rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]) successfully deleted
I20240502 20:46:30.687077 19883 tablet_copy_client.cc:523] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:30.688730 19883 tablet_bootstrap.cc:492] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:30.706352 19883 tablet_bootstrap.cc:492] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:30.706646 19883 tablet_bootstrap.cc:492] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:30.706856 19883 ts_tablet_manager.cc:1367] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.003s
I20240502 20:46:30.707378 19883 raft_consensus.cc:348] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.707521 19883 raft_consensus.cc:729] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:30.707625 19883 consensus_queue.cc:260] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.708066 19883 ts_tablet_manager.cc:1398] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:30.708573 16045 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-d61acdada50a42ba96d4844e64dba6a7 received from {username='slave'} at 127.9.82.133:49865
I20240502 20:46:30.708668 16045 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-d61acdada50a42ba96d4844e64dba6a7 on tablet d61acdada50a42ba96d4844e64dba6a7 with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:30.714614 19140 raft_consensus.cc:1050] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:30.715001 19140 consensus_queue.cc:237] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:30.716250 15762 raft_consensus.cc:1261] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.716348 15891 raft_consensus.cc:1261] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.716763 17771 raft_consensus.cc:1261] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.716732 19140 consensus_queue.cc:1035] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.718736 20219 consensus_queue.cc:1035] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.718930 17013 consensus_queue.cc:1035] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.721164 17013 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:30.721621 17771 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:30.722925 15891 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:30.723398 15762 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:30.724025 15490 catalog_manager.cc:5484] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:30.727715 16024 consensus_queue.cc:237] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:30.729030 15891 raft_consensus.cc:1261] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:30.729207 17771 raft_consensus.cc:1261] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:30.729369 20219 consensus_queue.cc:1035] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:30.729591 18079 consensus_queue.cc:1035] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:30.731144 18079 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:30.731782 17771 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:30.732097 15891 raft_consensus.cc:2932] T 68458e99b8b345428f95c3ef410545a3 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:30.732690 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 68458e99b8b345428f95c3ef410545a3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:30.734961 15482 catalog_manager.cc:5484] T 68458e99b8b345428f95c3ef410545a3 P 389fb867bde04f9980fe702dc1111079 reported cstate change: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:30.737380 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 68458e99b8b345428f95c3ef410545a3 with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:30.737789 20223 tablet_replica.cc:330] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:30.737923 20223 raft_consensus.cc:2229] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:30.738099 20223 raft_consensus.cc:2258] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:30.738698 20223 ts_tablet_manager.cc:1875] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:30.740626 20223 ts_tablet_manager.cc:1888] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:30.740697 20223 log.cc:1196] T 68458e99b8b345428f95c3ef410545a3 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/68458e99b8b345428f95c3ef410545a3
I20240502 20:46:30.741231 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 68458e99b8b345428f95c3ef410545a3 (table rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]) successfully deleted
I20240502 20:46:30.793632 17377 raft_consensus.cc:1203] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.830767 15891 consensus_queue.cc:237] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:30.832396 16024 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:30.832384 15762 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:46:30.832702 15830 consensus_peers.cc:485] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 -> Peer 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): Couldn't send request to peer 049bb73c1cda4f3a95adddfc2a6ea66f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89f653589b534402b873b05f9c15bf24. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:30.832913 19879 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:30.833099 20281 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:30.835134 20280 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:30.835698 16024 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:30.835753 15762 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } } }
I20240502 20:46:30.838507 15481 catalog_manager.cc:5484] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index -1 to 4, NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:30.841442 17509 raft_consensus.cc:1203] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.843930 19923 raft_consensus.cc:1050] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:30.844368 19923 consensus_queue.cc:237] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:30.846132 17771 raft_consensus.cc:1203] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.846316 15891 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.846643 17639 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.846724 15762 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.847283 20292 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.847605 20292 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.847769 19924 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.851173 20290 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:30.851603 15762 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:30.854327 15482 catalog_manager.cc:5484] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:30.854357 17639 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:30.858841 15891 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:30.862112 15632 consensus_queue.cc:237] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:30.863256 17639 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:30.863294 15891 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:30.863613 19924 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:30.863809 20292 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:30.865388 20290 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:30.867230 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 75f842e898b845f69b2617cc539b00db with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:30.867321 15891 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:30.867390 17639 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:30.868459 15482 catalog_manager.cc:5484] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 5 to 6, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:30.871989 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f842e898b845f69b2617cc539b00db with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:30.872495 20223 tablet_replica.cc:330] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:30.872639 20223 raft_consensus.cc:2229] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:30.872790 20223 raft_consensus.cc:2258] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:30.873513 20223 ts_tablet_manager.cc:1875] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:30.875344 20223 ts_tablet_manager.cc:1888] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:30.875416 20223 log.cc:1196] T 75f842e898b845f69b2617cc539b00db P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/75f842e898b845f69b2617cc539b00db
I20240502 20:46:30.875928 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 75f842e898b845f69b2617cc539b00db (table rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]) successfully deleted
I20240502 20:46:30.882951 17377 raft_consensus.cc:1203] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.900218 17377 raft_consensus.cc:1203] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:30.958730 20292 raft_consensus.cc:1050] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:30.959221 20292 consensus_queue.cc:237] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:30.960754 17378 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.960758 16024 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.961146 20290 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.961493 20290 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.962226 15762 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:30.962663 19924 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:30.963464 19924 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.963956 16024 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.965468 15762 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.965922 17378 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.967960 15481 catalog_manager.cc:5484] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.972259 15632 consensus_queue.cc:237] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:30.973362 15762 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:30.973707 17378 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:30.973723 20290 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:30.974078 20290 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:30.975406 20291 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.976167 15762 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.976267 17378 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:30.977051 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b5981b9676cb4abab938aeaf7fe52c3d with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:30.977804 15484 catalog_manager.cc:5484] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:30.980849 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet b5981b9676cb4abab938aeaf7fe52c3d with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:30.981354 20381 tablet_replica.cc:330] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:30.981511 20381 raft_consensus.cc:2229] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:30.981694 20381 raft_consensus.cc:2258] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:30.982260 20381 ts_tablet_manager.cc:1875] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:30.984045 20381 ts_tablet_manager.cc:1888] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:30.984112 20381 log.cc:1196] T b5981b9676cb4abab938aeaf7fe52c3d P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/b5981b9676cb4abab938aeaf7fe52c3d
I20240502 20:46:30.984588 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet b5981b9676cb4abab938aeaf7fe52c3d (table rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]) successfully deleted
I20240502 20:46:31.079859 20219 raft_consensus.cc:1050] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:31.080324 20219 consensus_queue.cc:237] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:31.081722 15762 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.081722 15632 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.081754 17509 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.082211 19140 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.082389 20219 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.082653 19140 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.084542 17013 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.084928 15632 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.085002 15763 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.087203 17509 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.088084 15484 catalog_manager.cc:5484] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.092666 16024 consensus_queue.cc:237] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:31.094040 15762 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.094413 18079 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.094830 17509 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.095755 18079 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.096454 20219 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.097137 15762 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.098218 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 601b3ef7a0e34242a97210ff74c9e8b3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:31.099376 15482 catalog_manager.cc:5484] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:31.099891 17509 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.102166 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet 601b3ef7a0e34242a97210ff74c9e8b3 with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:31.104081 20386 tablet_replica.cc:330] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:31.104245 20386 raft_consensus.cc:2229] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:31.104445 20386 raft_consensus.cc:2258] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:31.105573 20386 ts_tablet_manager.cc:1875] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:31.107883 20386 ts_tablet_manager.cc:1888] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:31.108014 20386 log.cc:1196] T 601b3ef7a0e34242a97210ff74c9e8b3 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/601b3ef7a0e34242a97210ff74c9e8b3
I20240502 20:46:31.108678 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet 601b3ef7a0e34242a97210ff74c9e8b3 (table rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]) successfully deleted
I20240502 20:46:31.289639 20219 raft_consensus.cc:1050] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:31.290068 20219 consensus_queue.cc:237] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:31.291563 15891 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.291990 17509 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.292054 18079 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.292296 15632 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.292431 17013 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.292884 17013 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.294309 18079 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.294740 17509 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.296272 15891 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.297067 15632 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.297355 15490 catalog_manager.cc:5484] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:31.300935 16024 consensus_queue.cc:237] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:31.301939 15891 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.302173 17509 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.302448 18079 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.302640 20219 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.304556 20219 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.305095 17509 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.305282 15891 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.306260 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 7460cf8211d24a3d97085d1a36116a29 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:31.307794 15481 catalog_manager.cc:5484] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:31.310024 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet 7460cf8211d24a3d97085d1a36116a29 with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:31.310307 20386 tablet_replica.cc:330] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:31.310461 20386 raft_consensus.cc:2229] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:31.310617 20386 raft_consensus.cc:2258] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:31.311363 20386 ts_tablet_manager.cc:1875] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:31.313333 20386 ts_tablet_manager.cc:1888] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:31.313403 20386 log.cc:1196] T 7460cf8211d24a3d97085d1a36116a29 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/7460cf8211d24a3d97085d1a36116a29
I20240502 20:46:31.313932 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet 7460cf8211d24a3d97085d1a36116a29 (table rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]) successfully deleted
I20240502 20:46:31.334921 20461 ts_tablet_manager.cc:902] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:31.335489 20461 tablet_copy_client.cc:308] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:31.336262 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet 89f653589b534402b873b05f9c15bf24 from peer 049bb73c1cda4f3a95adddfc2a6ea66f ({username='slave'} at 127.9.82.133:43731)
I20240502 20:46:31.336402 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet 89f653589b534402b873b05f9c15bf24 from peer 049bb73c1cda4f3a95adddfc2a6ea66f at {username='slave'} at 127.9.82.133:43731: session id = 049bb73c1cda4f3a95adddfc2a6ea66f-89f653589b534402b873b05f9c15bf24
I20240502 20:46:31.337458 15914 tablet_copy_source_session.cc:205] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:31.338511 20461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f653589b534402b873b05f9c15bf24. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:31.340721 20461 tablet_copy_client.cc:783] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:31.340898 20461 tablet_copy_client.cc:647] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:31.341883 20465 tablet_copy_client.cc:1002] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:31.344180 20291 raft_consensus.cc:1050] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:31.344552 20291 consensus_queue.cc:237] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:31.345842 17378 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.345970 15762 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.346081 15891 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.346385 20292 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.346550 19923 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.346721 20290 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.348852 20292 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.349323 17378 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.349443 15762 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.350929 15891 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.352114 15484 catalog_manager.cc:5484] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.355621 15632 consensus_queue.cc:237] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:31.357072 15762 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.357098 17378 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.357460 19923 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.357635 20290 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.359275 20291 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.359700 17378 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.359797 15762 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.361361 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:31.362118 15490 catalog_manager.cc:5484] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:31.364621 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:31.365077 20470 tablet_replica.cc:330] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:31.365226 20470 raft_consensus.cc:2229] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:31.365389 20470 raft_consensus.cc:2258] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:31.366043 20470 ts_tablet_manager.cc:1875] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:31.367825 20470 ts_tablet_manager.cc:1888] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:31.367890 20470 log.cc:1196] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/1eb03dc9cdf04f7a9ef9b96da66ab7dc
I20240502 20:46:31.368419 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc (table rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]) successfully deleted
I20240502 20:46:31.382953 20281 raft_consensus.cc:1050] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:31.383432 20281 consensus_queue.cc:237] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:31.384871 17377 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.384959 16024 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.385022 15632 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.385398 20471 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.385596 20473 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.385783 20281 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.388008 20473 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.388521 17377 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.390388 16024 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.390688 15482 catalog_manager.cc:5484] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:31.393007 15632 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.396626 15891 consensus_queue.cc:237] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:31.397708 17377 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.397707 15632 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.398074 19879 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.398255 20477 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.399821 20471 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.400280 15632 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.400377 17377 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.402186 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a87847912eaa4602abf9bd9cf2c698fd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:31.402788 15481 catalog_manager.cc:5484] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:31.404103 20471 raft_consensus.cc:1050] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:31.404479 20471 consensus_queue.cc:237] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:31.405542 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet a87847912eaa4602abf9bd9cf2c698fd with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:31.405889 20381 tablet_replica.cc:330] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:31.405956 15632 raft_consensus.cc:1261] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.406028 20381 raft_consensus.cc:2229] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:31.406205 20381 raft_consensus.cc:2258] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:31.406435 20471 consensus_queue.cc:1035] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.406729 15762 raft_consensus.cc:1261] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.406916 17771 raft_consensus.cc:1261] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.407413 20381 ts_tablet_manager.cc:1875] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:31.408042 20471 consensus_queue.cc:1035] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.408339 20471 consensus_queue.cc:1035] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.409616 20381 ts_tablet_manager.cc:1888] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:31.409970 19879 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:31.410542 17771 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:31.410823 15762 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:31.411628 20381 log.cc:1196] T a87847912eaa4602abf9bd9cf2c698fd P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/a87847912eaa4602abf9bd9cf2c698fd
I20240502 20:46:31.412341 15632 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:31.412703 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet a87847912eaa4602abf9bd9cf2c698fd (table rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]) successfully deleted
I20240502 20:46:31.414268 15482 catalog_manager.cc:5484] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 4 to 5, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:31.417102 15891 consensus_queue.cc:237] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:31.418247 17771 raft_consensus.cc:1261] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.418247 15762 raft_consensus.cc:1261] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.418658 20471 consensus_queue.cc:1035] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.418839 20473 consensus_queue.cc:1035] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.420469 20471 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:31.420948 15762 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:31.421813 17771 raft_consensus.cc:2932] T 702e67697b514f7fb3975d56c253d918 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:31.423110 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 702e67697b514f7fb3975d56c253d918 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:31.423882 15490 catalog_manager.cc:5484] T 702e67697b514f7fb3975d56c253d918 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 5 to 6, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:31.426751 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet 702e67697b514f7fb3975d56c253d918 with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:31.426985 20386 tablet_replica.cc:330] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:31.427139 20386 raft_consensus.cc:2229] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:31.427318 20386 raft_consensus.cc:2258] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:31.427950 20386 ts_tablet_manager.cc:1875] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:31.429878 20386 ts_tablet_manager.cc:1888] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:31.429955 20386 log.cc:1196] T 702e67697b514f7fb3975d56c253d918 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/702e67697b514f7fb3975d56c253d918
I20240502 20:46:31.430455 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet 702e67697b514f7fb3975d56c253d918 (table rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]) successfully deleted
I20240502 20:46:31.468031 18079 raft_consensus.cc:1050] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:31.468518 18079 consensus_queue.cc:237] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:31.470077 15762 raft_consensus.cc:1261] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.470153 15891 raft_consensus.cc:1261] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.470153 17377 raft_consensus.cc:1261] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:31.470525 19140 consensus_queue.cc:1035] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.470772 20219 consensus_queue.cc:1035] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.470889 17013 consensus_queue.cc:1035] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:31.472954 17013 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.473456 15762 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.474828 17377 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.474893 15891 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.477099 15481 catalog_manager.cc:5484] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:31.480621 16024 consensus_queue.cc:237] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:31.481765 15762 raft_consensus.cc:1261] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.482136 18079 consensus_queue.cc:1035] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.484138 18079 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.484413 17377 raft_consensus.cc:1261] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:31.484642 15762 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.484797 17013 consensus_queue.cc:1035] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:31.485848 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d61acdada50a42ba96d4844e64dba6a7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:31.485811 17377 raft_consensus.cc:2932] T d61acdada50a42ba96d4844e64dba6a7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:31.487516 15482 catalog_manager.cc:5484] T d61acdada50a42ba96d4844e64dba6a7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 5 to 6, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:31.490217 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet d61acdada50a42ba96d4844e64dba6a7 with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:31.490562 20470 tablet_replica.cc:330] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:31.490746 20470 raft_consensus.cc:2229] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:31.490911 20470 raft_consensus.cc:2258] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:31.492229 20470 ts_tablet_manager.cc:1875] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:31.494302 20470 ts_tablet_manager.cc:1888] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:31.494400 20470 log.cc:1196] T d61acdada50a42ba96d4844e64dba6a7 P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/d61acdada50a42ba96d4844e64dba6a7
I20240502 20:46:31.494951 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet d61acdada50a42ba96d4844e64dba6a7 (table rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]) successfully deleted
I20240502 20:46:32.842165 20461 tablet_copy_client.cc:523] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:32.843648 20461 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap starting.
I20240502 20:46:32.862751 20461 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:32.863055 20461 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: Bootstrap complete.
I20240502 20:46:32.863229 20461 ts_tablet_manager.cc:1367] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.004s
I20240502 20:46:32.863677 20461 raft_consensus.cc:348] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:32.863835 20461 raft_consensus.cc:729] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 049bb73c1cda4f3a95adddfc2a6ea66f, State: Initialized, Role: LEARNER
I20240502 20:46:32.863919 20461 consensus_queue.cc:260] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: true } }
I20240502 20:46:32.864243 20461 ts_tablet_manager.cc:1398] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:46:32.864898 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-89f653589b534402b873b05f9c15bf24 received from {username='slave'} at 127.9.82.133:43731
I20240502 20:46:32.864989 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 049bb73c1cda4f3a95adddfc2a6ea66f-89f653589b534402b873b05f9c15bf24 on tablet 89f653589b534402b873b05f9c15bf24 with peer 049bb73c1cda4f3a95adddfc2a6ea66f
I20240502 20:46:33.220918 17378 raft_consensus.cc:1203] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:46:33.740947 20592 raft_consensus.cc:1050] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 049bb73c1cda4f3a95adddfc2a6ea66f to VOTER
I20240502 20:46:33.741506 20592 consensus_queue.cc:237] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:33.743269 17378 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:33.743299 16024 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:33.743407 15762 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:46:33.743690 20594 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:33.743893 20592 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:33.744454 20592 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:46:33.746440 20591 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:33.746855 17378 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:33.747064 15762 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:33.748802 16024 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:33.749608 15484 catalog_manager.cc:5484] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 4 to 5, 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:33.753638 15891 consensus_queue.cc:237] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } }
I20240502 20:46:33.754755 17378 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:33.755128 20592 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:33.755178 15762 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:46:33.755569 20592 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:46:33.756916 20594 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:33.757424 17378 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:33.757534 15762 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } }
I20240502 20:46:33.758699 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 89f653589b534402b873b05f9c15bf24 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:33.759835 15482 catalog_manager.cc:5484] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 5 to 6, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:33.762178 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f653589b534402b873b05f9c15bf24 with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:33.762938 20603 tablet_replica.cc:330] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:33.763108 20603 raft_consensus.cc:2229] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:33.763293 20603 raft_consensus.cc:2258] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:33.763943 20603 ts_tablet_manager.cc:1875] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:33.765681 20603 ts_tablet_manager.cc:1888] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:46:33.765749 20603 log.cc:1196] T 89f653589b534402b873b05f9c15bf24 P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/89f653589b534402b873b05f9c15bf24
I20240502 20:46:33.766270 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet 89f653589b534402b873b05f9c15bf24 (table rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]) successfully deleted
I20240502 20:46:33.870121 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:33.870616 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:33.880347 17489 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:33.881645 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:33.882107 15610 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:33.884133 18645 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:33.888770 17751 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:33.898524 16004 tablet_service.cc:1429] Tablet server has 10 leaders and 0 scanners
I20240502 20:46:33.929185 17620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:33.963907 15632 consensus_queue.cc:237] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:33.965977 15762 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:33.966048 17378 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:33.966593 20662 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:33.967574 20568 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:33.968680 20662 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:33.969121 15762 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:33.970045 17378 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:33.972975 15486 catalog_manager.cc:5484] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
W20240502 20:46:33.973245 15566 consensus_peers.cc:485] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5981b9676cb4abab938aeaf7fe52c3d. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:33.981276 15891 consensus_queue.cc:237] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:33.982651 17639 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:33.982741 16024 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:33.983255 20471 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20240502 20:46:33.983438 15828 consensus_peers.cc:485] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86ff3421109a484f869fd29f63392186. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:33.983475 20592 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:33.985474 20591 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:33.985965 17639 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:33.986052 16024 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:33.988757 15484 catalog_manager.cc:5484] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:33.997737 15891 consensus_queue.cc:237] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:33.999365 17378 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:33.999490 15829 consensus_peers.cc:485] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a87847912eaa4602abf9bd9cf2c698fd. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:33.999534 15632 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:33.999847 20471 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.000077 20594 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.001886 20592 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.002406 15632 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.003456 17378 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.005371 15486 catalog_manager.cc:5484] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.013684 16024 consensus_queue.cc:237] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:34.015161 15891 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.015168 17378 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:34.015442 15960 consensus_peers.cc:485] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15214db73de54afba83b983bc2865948. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.015620 20689 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.015863 20584 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.017712 20689 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.018332 15891 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.018400 17378 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.021349 15481 catalog_manager.cc:5484] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:34.029302 16024 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:34.030903 17378 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.031364 15762 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.031778 20584 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.031994 20543 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.033915 20543 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
W20240502 20:46:34.036188 15959 consensus_peers.cc:485] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2436658a9dd54854a8920f9242068ee7. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.036029 17378 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.036975 15486 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:34.037073 15763 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.051575 16024 consensus_queue.cc:237] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:34.053180 15891 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.053390 17509 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:34.053467 15960 consensus_peers.cc:485] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1694de56984a4ca78f9dabaaca2677de. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.053669 20584 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.053817 20543 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.055766 20543 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.056120 17509 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.056444 15891 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.058923 15481 catalog_manager.cc:5484] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 reported cstate change: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.067505 15762 consensus_queue.cc:237] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
W20240502 20:46:34.069232 15697 consensus_peers.cc:485] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 281af65f89524fdeba2c97322a482009. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.069239 17378 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.069636 16024 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.069676 20717 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.070039 20206 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.071583 20717 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:34.072266 17378 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:34.072337 16024 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:34.075002 15486 catalog_manager.cc:5484] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:34.083158 15891 consensus_queue.cc:237] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:34.084686 15632 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.084983 17509 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.085070 20591 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.085455 20592 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.087145 20591 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.087785 15632 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.089071 17509 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.090536 15484 catalog_manager.cc:5484] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
W20240502 20:46:34.090915 15828 consensus_peers.cc:485] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce9c2a00fa6b43938a7eb89a82bae6ce. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.099776 15632 consensus_queue.cc:237] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:34.101202 17378 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.101271 15762 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:34.101583 15567 consensus_peers.cc:485] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1eb03dc9cdf04f7a9ef9b96da66ab7dc. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.101651 20662 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.101816 20568 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.103762 20590 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.104229 17378 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.104346 15762 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.107060 15486 catalog_manager.cc:5484] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f reported cstate change: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.116189 15632 consensus_queue.cc:237] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:34.117893 15891 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.118110 17378 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:34.118431 15566 consensus_peers.cc:485] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: effe8b25103e4fd6abafde8c7b425165. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.118434 20662 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.118639 20590 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.120601 20662 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.121055 15891 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.123498 15490 catalog_manager.cc:5484] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.125771 17378 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.133270 15632 consensus_queue.cc:237] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:34.134843 15891 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:34.134946 15567 consensus_peers.cc:485] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e16f4c2f41e41eeb40b67b147296581. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.135270 20662 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.135350 17771 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.135838 20662 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.137200 20590 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.139600 15891 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.139670 17771 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.140190 15490 catalog_manager.cc:5484] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:34.150426 16024 consensus_queue.cc:237] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:34.151937 15891 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.152019 17509 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:34.152149 15960 consensus_peers.cc:485] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687): Couldn't send request to peer 389fb867bde04f9980fe702dc1111079. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7460cf8211d24a3d97085d1a36116a29. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.152339 20689 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.152611 20689 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.154341 20689 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.154681 17509 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.157140 15490 catalog_manager.cc:5484] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 reported cstate change: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.161873 15891 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 389fb867bde04f9980fe702dc1111079 (127.9.82.136) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } } }
I20240502 20:46:34.168232 15632 consensus_queue.cc:237] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:34.169804 17639 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.169893 15762 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:34.170071 15566 consensus_peers.cc:485] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60c7001f651848b788926cde86a3c0f6. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.170300 20662 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.170542 20590 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.172083 20662 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:34.172493 15762 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:34.172945 17639 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:34.175113 15481 catalog_manager.cc:5484] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 6 to 7, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:34.184327 15632 consensus_queue.cc:237] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:34.185806 15891 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:34.185890 15566 consensus_peers.cc:485] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75f842e898b845f69b2617cc539b00db. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.185866 17639 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.186252 20568 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.186443 20590 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.188263 20662 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.188732 15891 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.188714 17639 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:34.191102 15490 catalog_manager.cc:5484] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:34.199370 15632 consensus_queue.cc:237] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:34.200893 15762 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:34.200906 17509 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:34.201093 15567 consensus_peers.cc:485] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733): Couldn't send request to peer 47eb2a910e8949308b382a74c55030b5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6521649137d4bab9ecf18c8f81abaed. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:34.201382 20590 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.202148 20590 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:34.203991 20568 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.204480 15762 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.206228 17509 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.207789 15481 catalog_manager.cc:5484] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 6 to 7, NON_VOTER 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } } }
I20240502 20:46:34.351933 20862 ts_tablet_manager.cc:902] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:34.352696 20862 tablet_copy_client.cc:308] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:34.356098 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet b5981b9676cb4abab938aeaf7fe52c3d from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:50819)
I20240502 20:46:34.356209 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet b5981b9676cb4abab938aeaf7fe52c3d from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:50819: session id = 0eff851f85a5413c8847f817e3742379-b5981b9676cb4abab938aeaf7fe52c3d
I20240502 20:46:34.357085 15652 tablet_copy_source_session.cc:205] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.360299 20862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5981b9676cb4abab938aeaf7fe52c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.365279 20862 tablet_copy_client.cc:783] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.365463 20862 tablet_copy_client.cc:647] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.366734 20864 tablet_copy_client.cc:1002] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.444243 20868 ts_tablet_manager.cc:902] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:34.444790 20868 tablet_copy_client.cc:308] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:34.445349 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet 86ff3421109a484f869fd29f63392186 from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:42117)
I20240502 20:46:34.445467 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet 86ff3421109a484f869fd29f63392186 from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:42117: session id = 376b7736472c4bf2836c4303abf8e6c3-86ff3421109a484f869fd29f63392186
I20240502 20:46:34.446218 15914 tablet_copy_source_session.cc:205] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.447136 20868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86ff3421109a484f869fd29f63392186. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.448997 20868 tablet_copy_client.cc:783] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.449141 20868 tablet_copy_client.cc:647] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.450134 20872 tablet_copy_client.cc:1002] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.536724 20908 ts_tablet_manager.cc:902] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:34.537534 20908 tablet_copy_client.cc:308] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:34.538946 20913 ts_tablet_manager.cc:902] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:34.539487 20913 tablet_copy_client.cc:308] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:34.540019 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 15214db73de54afba83b983bc2865948 from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:38827)
I20240502 20:46:34.540123 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 15214db73de54afba83b983bc2865948 from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:38827: session id = 389fb867bde04f9980fe702dc1111079-15214db73de54afba83b983bc2865948
I20240502 20:46:34.540886 16045 tablet_copy_source_session.cc:205] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.541507 16045 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 2436658a9dd54854a8920f9242068ee7 from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:60207)
I20240502 20:46:34.541591 16045 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 2436658a9dd54854a8920f9242068ee7 from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:60207: session id = 0eff851f85a5413c8847f817e3742379-2436658a9dd54854a8920f9242068ee7
I20240502 20:46:34.542328 16045 tablet_copy_source_session.cc:205] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.542654 20913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15214db73de54afba83b983bc2865948. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.543187 20908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2436658a9dd54854a8920f9242068ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.544827 20913 tablet_copy_client.cc:783] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.544973 20913 tablet_copy_client.cc:647] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.545392 20908 tablet_copy_client.cc:783] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.545553 20908 tablet_copy_client.cc:647] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.546607 20914 tablet_copy_client.cc:1002] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.546754 20912 tablet_copy_client.cc:1002] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.552058 20928 ts_tablet_manager.cc:902] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:34.552634 20928 tablet_copy_client.cc:308] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:34.553086 16044 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 7460cf8211d24a3d97085d1a36116a29 from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:38827)
I20240502 20:46:34.553190 16044 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 7460cf8211d24a3d97085d1a36116a29 from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:38827: session id = 389fb867bde04f9980fe702dc1111079-7460cf8211d24a3d97085d1a36116a29
I20240502 20:46:34.554163 16044 tablet_copy_source_session.cc:205] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.555380 20928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7460cf8211d24a3d97085d1a36116a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.557790 20928 tablet_copy_client.cc:783] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.557948 20928 tablet_copy_client.cc:647] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.559109 20931 tablet_copy_client.cc:1002] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.614270 20963 ts_tablet_manager.cc:902] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:34.614779 20963 tablet_copy_client.cc:308] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:34.615273 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet a87847912eaa4602abf9bd9cf2c698fd from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:43011)
I20240502 20:46:34.615373 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet a87847912eaa4602abf9bd9cf2c698fd from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:43011: session id = 47eb2a910e8949308b382a74c55030b5-a87847912eaa4602abf9bd9cf2c698fd
I20240502 20:46:34.616156 15914 tablet_copy_source_session.cc:205] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.616987 20963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a87847912eaa4602abf9bd9cf2c698fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.618800 20963 tablet_copy_client.cc:783] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.618932 20968 ts_tablet_manager.cc:902] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:34.618954 20963 tablet_copy_client.cc:647] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.619518 20968 tablet_copy_client.cc:308] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:34.620026 20967 tablet_copy_client.cc:1002] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.620060 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc from peer 389fb867bde04f9980fe702dc1111079 ({username='slave'} at 127.9.82.136:58537)
I20240502 20:46:34.620182 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc from peer 389fb867bde04f9980fe702dc1111079 at {username='slave'} at 127.9.82.136:58537: session id = 389fb867bde04f9980fe702dc1111079-1eb03dc9cdf04f7a9ef9b96da66ab7dc
I20240502 20:46:34.621031 15652 tablet_copy_source_session.cc:205] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.621320 20973 ts_tablet_manager.cc:902] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937)
I20240502 20:46:34.621867 20973 tablet_copy_client.cc:308] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:32937
I20240502 20:46:34.621948 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.622407 15783 tablet_copy_service.cc:140] P 0dfebe1fc59a48debca946314a5e3d0a: Received BeginTabletCopySession request for tablet 281af65f89524fdeba2c97322a482009 from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:38207)
I20240502 20:46:34.622534 15783 tablet_copy_service.cc:161] P 0dfebe1fc59a48debca946314a5e3d0a: Beginning new tablet copy session on tablet 281af65f89524fdeba2c97322a482009 from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:38207: session id = 376b7736472c4bf2836c4303abf8e6c3-281af65f89524fdeba2c97322a482009
I20240502 20:46:34.623397 15783 tablet_copy_source_session.cc:205] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.623829 20968 tablet_copy_client.cc:783] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.624013 20968 tablet_copy_client.cc:647] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.624652 20973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281af65f89524fdeba2c97322a482009. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.625116 20972 tablet_copy_client.cc:1002] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.626461 20973 tablet_copy_client.cc:783] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.626581 20973 tablet_copy_client.cc:647] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.627611 20977 tablet_copy_client.cc:1002] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.662694 20978 ts_tablet_manager.cc:902] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:34.663319 20978 tablet_copy_client.cc:308] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:34.663918 16044 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 1694de56984a4ca78f9dabaaca2677de from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:58231)
I20240502 20:46:34.664038 16044 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 1694de56984a4ca78f9dabaaca2677de from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:58231: session id = 47eb2a910e8949308b382a74c55030b5-1694de56984a4ca78f9dabaaca2677de
I20240502 20:46:34.664798 16044 tablet_copy_source_session.cc:205] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.665664 20978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1694de56984a4ca78f9dabaaca2677de. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.667420 20978 tablet_copy_client.cc:783] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.667621 20978 tablet_copy_client.cc:647] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.668686 20982 tablet_copy_client.cc:1002] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.674490 20983 ts_tablet_manager.cc:902] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:34.675038 20983 tablet_copy_client.cc:308] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:34.675550 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet a6521649137d4bab9ecf18c8f81abaed from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:53037)
I20240502 20:46:34.675675 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet a6521649137d4bab9ecf18c8f81abaed from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:53037: session id = 47eb2a910e8949308b382a74c55030b5-a6521649137d4bab9ecf18c8f81abaed
I20240502 20:46:34.676643 15652 tablet_copy_source_session.cc:205] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.677557 20983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6521649137d4bab9ecf18c8f81abaed. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.678771 20988 ts_tablet_manager.cc:902] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:34.679365 20988 tablet_copy_client.cc:308] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:34.681087 20983 tablet_copy_client.cc:783] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.681245 20983 tablet_copy_client.cc:647] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.682472 20987 tablet_copy_client.cc:1002] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.683645 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet ce9c2a00fa6b43938a7eb89a82bae6ce from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:58375)
I20240502 20:46:34.683781 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet ce9c2a00fa6b43938a7eb89a82bae6ce from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:58375: session id = 0eff851f85a5413c8847f817e3742379-ce9c2a00fa6b43938a7eb89a82bae6ce
I20240502 20:46:34.684698 15914 tablet_copy_source_session.cc:205] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.685719 20988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce9c2a00fa6b43938a7eb89a82bae6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.688133 20988 tablet_copy_client.cc:783] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.688302 20988 tablet_copy_client.cc:647] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.689404 20989 tablet_copy_client.cc:1002] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.695201 20993 ts_tablet_manager.cc:902] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:34.695798 20993 tablet_copy_client.cc:308] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:34.696362 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet effe8b25103e4fd6abafde8c7b425165 from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:50819)
I20240502 20:46:34.696487 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet effe8b25103e4fd6abafde8c7b425165 from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:50819: session id = 0eff851f85a5413c8847f817e3742379-effe8b25103e4fd6abafde8c7b425165
I20240502 20:46:34.697261 15652 tablet_copy_source_session.cc:205] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.698201 20993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effe8b25103e4fd6abafde8c7b425165. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.700115 20993 tablet_copy_client.cc:783] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.700265 20993 tablet_copy_client.cc:647] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.701330 20995 tablet_copy_client.cc:1002] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.729156 20998 ts_tablet_manager.cc:902] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:34.729718 20998 tablet_copy_client.cc:308] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:34.730234 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 75f842e898b845f69b2617cc539b00db from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:50819)
I20240502 20:46:34.730353 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 75f842e898b845f69b2617cc539b00db from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:50819: session id = 0eff851f85a5413c8847f817e3742379-75f842e898b845f69b2617cc539b00db
I20240502 20:46:34.731189 15652 tablet_copy_source_session.cc:205] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.732093 20998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75f842e898b845f69b2617cc539b00db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.733840 20998 tablet_copy_client.cc:783] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.733992 20998 tablet_copy_client.cc:647] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.735039 21002 tablet_copy_client.cc:1002] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.751049 21004 ts_tablet_manager.cc:902] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:34.751705 21004 tablet_copy_client.cc:308] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:34.752297 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 60c7001f651848b788926cde86a3c0f6 from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:50153)
I20240502 20:46:34.752419 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 60c7001f651848b788926cde86a3c0f6 from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:50153: session id = 376b7736472c4bf2836c4303abf8e6c3-60c7001f651848b788926cde86a3c0f6
I20240502 20:46:34.753137 15652 tablet_copy_source_session.cc:205] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.753938 21004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60c7001f651848b788926cde86a3c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.755666 21004 tablet_copy_client.cc:783] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.756294 21004 tablet_copy_client.cc:647] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.757486 21008 tablet_copy_client.cc:1002] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:34.757632 21009 ts_tablet_manager.cc:902] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:34.758322 21009 tablet_copy_client.cc:308] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:34.758805 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 3e16f4c2f41e41eeb40b67b147296581 from peer 47eb2a910e8949308b382a74c55030b5 ({username='slave'} at 127.9.82.135:53037)
I20240502 20:46:34.758896 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 3e16f4c2f41e41eeb40b67b147296581 from peer 47eb2a910e8949308b382a74c55030b5 at {username='slave'} at 127.9.82.135:53037: session id = 47eb2a910e8949308b382a74c55030b5-3e16f4c2f41e41eeb40b67b147296581
I20240502 20:46:34.759541 15652 tablet_copy_source_session.cc:205] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:34.760324 21009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e16f4c2f41e41eeb40b67b147296581. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:34.762006 21009 tablet_copy_client.cc:783] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:34.762171 21009 tablet_copy_client.cc:647] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:34.763284 21013 tablet_copy_client.cc:1002] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:35.867220 20862 tablet_copy_client.cc:523] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:35.869840 20862 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:35.875424 20862 log.cc:824] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:35.895910 20862 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:35.896311 20862 tablet_bootstrap.cc:492] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:35.896657 20862 ts_tablet_manager.cc:1367] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.027s user 0.027s sys 0.001s
I20240502 20:46:35.899187 20862 raft_consensus.cc:348] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:35.899441 20862 raft_consensus.cc:729] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:35.899796 20862 consensus_queue.cc:260] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:35.900715 20862 ts_tablet_manager.cc:1398] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 20:46:35.901377 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-b5981b9676cb4abab938aeaf7fe52c3d received from {username='slave'} at 127.9.82.137:50819
I20240502 20:46:35.901471 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 0eff851f85a5413c8847f817e3742379-b5981b9676cb4abab938aeaf7fe52c3d on tablet b5981b9676cb4abab938aeaf7fe52c3d with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:35.950531 20868 tablet_copy_client.cc:523] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:35.951996 20868 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:35.975708 20868 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:35.976101 20868 tablet_bootstrap.cc:492] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:35.976326 20868 ts_tablet_manager.cc:1367] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.024s user 0.023s sys 0.000s
I20240502 20:46:35.976828 20868 raft_consensus.cc:348] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:35.976989 20868 raft_consensus.cc:729] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:35.977100 20868 consensus_queue.cc:260] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:35.977458 20868 ts_tablet_manager.cc:1398] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:46:35.978101 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-86ff3421109a484f869fd29f63392186 received from {username='slave'} at 127.9.82.134:42117
I20240502 20:46:35.978191 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-86ff3421109a484f869fd29f63392186 on tablet 86ff3421109a484f869fd29f63392186 with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:36.046902 20913 tablet_copy_client.cc:523] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.047277 20908 tablet_copy_client.cc:523] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.048626 20913 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:36.048776 20908 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:36.059448 20928 tablet_copy_client.cc:523] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.061427 20928 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:36.073225 20913 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.073576 20913 tablet_bootstrap.cc:492] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:36.073832 20913 ts_tablet_manager.cc:1367] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.025s user 0.024s sys 0.000s
I20240502 20:46:36.074311 20913 raft_consensus.cc:348] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:36.074424 20913 raft_consensus.cc:729] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:36.074540 20913 consensus_queue.cc:260] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:36.075430 20913 ts_tablet_manager.cc:1398] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:36.075949 16044 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-15214db73de54afba83b983bc2865948 received from {username='slave'} at 127.9.82.136:38827
I20240502 20:46:36.076035 16044 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 389fb867bde04f9980fe702dc1111079-15214db73de54afba83b983bc2865948 on tablet 15214db73de54afba83b983bc2865948 with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:36.085422 20928 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.085744 20928 tablet_bootstrap.cc:492] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:36.085922 20928 ts_tablet_manager.cc:1367] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.025s user 0.020s sys 0.001s
I20240502 20:46:36.086298 20928 raft_consensus.cc:348] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:36.086436 20928 raft_consensus.cc:729] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:36.086463 20908 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.086544 20928 consensus_queue.cc:260] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:36.086762 20908 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:36.086834 20928 ts_tablet_manager.cc:1398] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:36.086967 20908 ts_tablet_manager.cc:1367] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.038s user 0.021s sys 0.000s
I20240502 20:46:36.087307 16044 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-7460cf8211d24a3d97085d1a36116a29 received from {username='slave'} at 127.9.82.136:38827
I20240502 20:46:36.087397 16044 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 389fb867bde04f9980fe702dc1111079-7460cf8211d24a3d97085d1a36116a29 on tablet 7460cf8211d24a3d97085d1a36116a29 with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:36.087541 20908 raft_consensus.cc:348] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.087672 20908 raft_consensus.cc:729] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:36.087834 20908 consensus_queue.cc:260] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.088128 20908 ts_tablet_manager.cc:1398] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.001s user 0.000s sys 0.004s
I20240502 20:46:36.088711 16044 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-2436658a9dd54854a8920f9242068ee7 received from {username='slave'} at 127.9.82.137:60207
I20240502 20:46:36.088794 16044 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 0eff851f85a5413c8847f817e3742379-2436658a9dd54854a8920f9242068ee7 on tablet 2436658a9dd54854a8920f9242068ee7 with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:36.120349 20963 tablet_copy_client.cc:523] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.121750 20963 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:36.125447 20968 tablet_copy_client.cc:523] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.126983 20968 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: Bootstrap starting.
I20240502 20:46:36.127955 20973 tablet_copy_client.cc:523] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.129227 20973 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:36.149313 20973 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.149649 20973 tablet_bootstrap.cc:492] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:36.149850 20973 ts_tablet_manager.cc:1367] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.021s user 0.019s sys 0.000s
I20240502 20:46:36.150358 20973 raft_consensus.cc:348] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:36.150476 20973 raft_consensus.cc:729] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:36.150596 20973 consensus_queue.cc:260] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:36.150910 20973 ts_tablet_manager.cc:1398] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:36.151252 20963 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.151708 20963 tablet_bootstrap.cc:492] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:36.151921 20963 ts_tablet_manager.cc:1367] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.030s user 0.025s sys 0.004s
I20240502 20:46:36.152348 20963 raft_consensus.cc:348] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:36.152477 20963 raft_consensus.cc:729] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:36.152572 20963 consensus_queue.cc:260] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:36.152926 20963 ts_tablet_manager.cc:1398] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:36.155428 20968 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.155745 20968 tablet_bootstrap.cc:492] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: Bootstrap complete.
I20240502 20:46:36.155938 20968 ts_tablet_manager.cc:1367] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: Time spent bootstrapping tablet: real 0.029s user 0.030s sys 0.000s
I20240502 20:46:36.156419 15783 tablet_copy_service.cc:342] P 0dfebe1fc59a48debca946314a5e3d0a: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-281af65f89524fdeba2c97322a482009 received from {username='slave'} at 127.9.82.134:38207
I20240502 20:46:36.156525 15783 tablet_copy_service.cc:433] P 0dfebe1fc59a48debca946314a5e3d0a: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-281af65f89524fdeba2c97322a482009 on tablet 281af65f89524fdeba2c97322a482009 with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:36.156986 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-a87847912eaa4602abf9bd9cf2c698fd received from {username='slave'} at 127.9.82.135:43011
I20240502 20:46:36.157076 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-a87847912eaa4602abf9bd9cf2c698fd on tablet a87847912eaa4602abf9bd9cf2c698fd with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:36.157752 18676 raft_consensus.cc:1203] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.159389 20968 raft_consensus.cc:348] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:36.159504 20968 raft_consensus.cc:729] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Initialized, Role: LEARNER
I20240502 20:46:36.159605 20968 consensus_queue.cc:260] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: true } }
I20240502 20:46:36.160341 20968 ts_tablet_manager.cc:1398] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:46:36.160864 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 389fb867bde04f9980fe702dc1111079-1eb03dc9cdf04f7a9ef9b96da66ab7dc received from {username='slave'} at 127.9.82.136:58537
I20240502 20:46:36.160954 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 389fb867bde04f9980fe702dc1111079-1eb03dc9cdf04f7a9ef9b96da66ab7dc on tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc with peer 389fb867bde04f9980fe702dc1111079
I20240502 20:46:36.168946 20978 tablet_copy_client.cc:523] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.170310 20978 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:36.182811 20983 tablet_copy_client.cc:523] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.184284 20983 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:36.189693 20988 tablet_copy_client.cc:523] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.191030 20988 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:36.193207 20978 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.193481 20978 tablet_bootstrap.cc:492] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:36.193651 20978 ts_tablet_manager.cc:1367] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.023s user 0.022s sys 0.000s
I20240502 20:46:36.194124 20978 raft_consensus.cc:348] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:36.194264 20978 raft_consensus.cc:729] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:36.194367 20978 consensus_queue.cc:260] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:36.194757 20978 ts_tablet_manager.cc:1398] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:46:36.195675 16044 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-1694de56984a4ca78f9dabaaca2677de received from {username='slave'} at 127.9.82.135:58231
I20240502 20:46:36.195781 16044 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-1694de56984a4ca78f9dabaaca2677de on tablet 1694de56984a4ca78f9dabaaca2677de with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:36.201627 20993 tablet_copy_client.cc:523] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.203066 20993 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:36.212105 20983 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.212419 20983 tablet_bootstrap.cc:492] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:36.212594 20983 ts_tablet_manager.cc:1367] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.028s user 0.019s sys 0.008s
I20240502 20:46:36.213083 20983 raft_consensus.cc:348] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:36.213205 20983 raft_consensus.cc:729] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:36.213227 20988 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.213358 20983 consensus_queue.cc:260] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:36.213508 20988 tablet_bootstrap.cc:492] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:36.213644 20988 ts_tablet_manager.cc:1367] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.023s user 0.020s sys 0.000s
I20240502 20:46:36.213702 20983 ts_tablet_manager.cc:1398] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:36.214012 20988 raft_consensus.cc:348] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.214115 20988 raft_consensus.cc:729] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:36.214196 20988 consensus_queue.cc:260] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.214295 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-a6521649137d4bab9ecf18c8f81abaed received from {username='slave'} at 127.9.82.135:53037
I20240502 20:46:36.214378 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-a6521649137d4bab9ecf18c8f81abaed on tablet a6521649137d4bab9ecf18c8f81abaed with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:36.214422 20988 ts_tablet_manager.cc:1398] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:36.215493 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-ce9c2a00fa6b43938a7eb89a82bae6ce received from {username='slave'} at 127.9.82.137:58375
I20240502 20:46:36.215565 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 0eff851f85a5413c8847f817e3742379-ce9c2a00fa6b43938a7eb89a82bae6ce on tablet ce9c2a00fa6b43938a7eb89a82bae6ce with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:36.216213 18676 raft_consensus.cc:1203] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.229849 20993 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.230185 20993 tablet_bootstrap.cc:492] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:36.230365 20993 ts_tablet_manager.cc:1367] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.027s user 0.017s sys 0.004s
I20240502 20:46:36.230886 20993 raft_consensus.cc:348] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.230998 20993 raft_consensus.cc:729] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:36.231086 20993 consensus_queue.cc:260] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.231359 20993 ts_tablet_manager.cc:1398] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.001s user 0.002s sys 0.001s
I20240502 20:46:36.232061 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-effe8b25103e4fd6abafde8c7b425165 received from {username='slave'} at 127.9.82.137:50819
I20240502 20:46:36.232167 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 0eff851f85a5413c8847f817e3742379-effe8b25103e4fd6abafde8c7b425165 on tablet effe8b25103e4fd6abafde8c7b425165 with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:36.235301 20998 tablet_copy_client.cc:523] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.236536 20998 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:36.254832 20998 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.255118 20998 tablet_bootstrap.cc:492] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:36.255293 20998 ts_tablet_manager.cc:1367] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20240502 20:46:36.255712 20998 raft_consensus.cc:348] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.255869 20998 raft_consensus.cc:729] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:36.255982 20998 consensus_queue.cc:260] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.256224 20998 ts_tablet_manager.cc:1398] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:46:36.256911 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-75f842e898b845f69b2617cc539b00db received from {username='slave'} at 127.9.82.137:50819
I20240502 20:46:36.257012 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 0eff851f85a5413c8847f817e3742379-75f842e898b845f69b2617cc539b00db on tablet 75f842e898b845f69b2617cc539b00db with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:36.257850 21004 tablet_copy_client.cc:523] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.259322 21004 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:36.263638 21009 tablet_copy_client.cc:523] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:36.265121 21009 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: Bootstrap starting.
I20240502 20:46:36.277434 17509 raft_consensus.cc:1203] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.281358 18676 raft_consensus.cc:1203] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.296625 21009 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.296972 21009 tablet_bootstrap.cc:492] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: Bootstrap complete.
I20240502 20:46:36.297169 21009 ts_tablet_manager.cc:1367] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: Time spent bootstrapping tablet: real 0.032s user 0.029s sys 0.000s
I20240502 20:46:36.297667 21009 raft_consensus.cc:348] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:36.297850 21009 raft_consensus.cc:729] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Initialized, Role: LEARNER
I20240502 20:46:36.297976 21009 consensus_queue.cc:260] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: NON_VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: true } }
I20240502 20:46:36.298662 21004 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:36.298977 21004 tablet_bootstrap.cc:492] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:36.299160 21004 ts_tablet_manager.cc:1367] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.040s user 0.021s sys 0.005s
I20240502 20:46:36.299597 21004 raft_consensus.cc:348] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:36.299768 21004 raft_consensus.cc:729] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:36.299880 21004 consensus_queue.cc:260] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:36.300216 21004 ts_tablet_manager.cc:1398] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.001s user 0.000s sys 0.004s
I20240502 20:46:36.300350 21009 ts_tablet_manager.cc:1398] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:36.301005 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-60c7001f651848b788926cde86a3c0f6 received from {username='slave'} at 127.9.82.134:50153
I20240502 20:46:36.301095 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-60c7001f651848b788926cde86a3c0f6 on tablet 60c7001f651848b788926cde86a3c0f6 with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:36.303109 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 47eb2a910e8949308b382a74c55030b5-3e16f4c2f41e41eeb40b67b147296581 received from {username='slave'} at 127.9.82.135:53037
I20240502 20:46:36.303195 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 47eb2a910e8949308b382a74c55030b5-3e16f4c2f41e41eeb40b67b147296581 on tablet 3e16f4c2f41e41eeb40b67b147296581 with peer 47eb2a910e8949308b382a74c55030b5
I20240502 20:46:36.335009 17639 raft_consensus.cc:1203] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.375980 17509 raft_consensus.cc:1203] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.376024 18676 raft_consensus.cc:1203] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.437563 17639 raft_consensus.cc:1203] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.445101 17509 raft_consensus.cc:1203] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.464758 17639 raft_consensus.cc:1203] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.476608 17771 raft_consensus.cc:1203] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.481997 17771 raft_consensus.cc:1203] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.574641 18676 raft_consensus.cc:1203] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.582039 20543 raft_consensus.cc:1050] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:36.582515 20543 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:36.584061 15762 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.584179 17377 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.584251 18676 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.584601 21508 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.584777 20689 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.584983 20543 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.587641 20543 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.589718 15762 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.589931 17377 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.589829 18676 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.592567 15490 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.596918 16024 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:36.598147 17377 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.598553 18676 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.598816 20689 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.599162 20689 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.600957 20689 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.601691 18676 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.603040 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2436658a9dd54854a8920f9242068ee7 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:36.603252 17377 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.604224 15481 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:36.608428 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 2436658a9dd54854a8920f9242068ee7 with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:36.608830 21526 tablet_replica.cc:330] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:36.609236 21526 raft_consensus.cc:2229] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:36.609541 21526 raft_consensus.cc:2258] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:36.610224 21526 ts_tablet_manager.cc:1875] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:36.612461 21526 ts_tablet_manager.cc:1888] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:36.612550 21526 log.cc:1196] T 2436658a9dd54854a8920f9242068ee7 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/2436658a9dd54854a8920f9242068ee7
I20240502 20:46:36.613360 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 2436658a9dd54854a8920f9242068ee7 (table rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]) successfully deleted
I20240502 20:46:36.615110 17771 raft_consensus.cc:1203] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.640292 17639 raft_consensus.cc:1203] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:36.656297 21091 raft_consensus.cc:1050] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:36.656713 21091 consensus_queue.cc:237] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:36.658246 17509 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.658432 15632 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.659013 21563 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.659144 18676 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.659206 21570 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.659791 21569 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.670878 21569 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.671454 17509 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.671651 18676 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.674875 15490 catalog_manager.cc:5484] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379 reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.675757 15632 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.679685 15891 consensus_queue.cc:237] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:36.681399 17509 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.681524 18676 raft_consensus.cc:1261] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.681823 21570 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.682215 21570 consensus_queue.cc:1035] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.683979 21563 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.684242 17509 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.685849 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ce9c2a00fa6b43938a7eb89a82bae6ce with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:36.687008 15486 catalog_manager.cc:5484] T ce9c2a00fa6b43938a7eb89a82bae6ce P 376b7736472c4bf2836c4303abf8e6c3 reported cstate change: config changed from index 8 to 9, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.688026 18676 raft_consensus.cc:2932] T ce9c2a00fa6b43938a7eb89a82bae6ce P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.689967 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet ce9c2a00fa6b43938a7eb89a82bae6ce with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:36.690603 21589 tablet_replica.cc:330] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:36.690863 21589 raft_consensus.cc:2229] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:36.691149 21589 raft_consensus.cc:2258] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:36.692035 21589 ts_tablet_manager.cc:1875] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:36.694480 21589 ts_tablet_manager.cc:1888] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:36.694556 21589 log.cc:1196] T ce9c2a00fa6b43938a7eb89a82bae6ce P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/ce9c2a00fa6b43938a7eb89a82bae6ce
I20240502 20:46:36.695139 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet ce9c2a00fa6b43938a7eb89a82bae6ce (table rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]) successfully deleted
I20240502 20:46:36.703892 15891 consensus_queue.cc:237] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.705330 17771 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:36.705405 16024 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:36.705711 15828 consensus_peers.cc:485] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 167efd92157a42ec84ea1cfb1de4a15c. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:36.705760 21569 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:36.705998 21563 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:36.707628 20786 raft_consensus.cc:1050] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:36.707978 21091 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:36.708077 20786 consensus_queue.cc:237] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:36.708425 17771 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:36.709867 17377 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.710300 18676 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.710733 15762 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.710804 16024 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:36.711257 21003 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.711514 21592 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.711666 21003 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.713251 15485 catalog_manager.cc:5484] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:36.715269 21003 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.717367 17377 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.717561 18676 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.717852 15481 catalog_manager.cc:5484] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:36.721274 15762 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.724222 15632 consensus_queue.cc:237] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:36.725638 18676 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.726224 17377 raft_consensus.cc:1261] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.726439 21592 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.726972 20786 consensus_queue.cc:1035] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.728647 21592 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.729637 17377 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.730285 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b5981b9676cb4abab938aeaf7fe52c3d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:36.730553 18676 raft_consensus.cc:2932] T b5981b9676cb4abab938aeaf7fe52c3d P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.732254 15486 catalog_manager.cc:5484] T b5981b9676cb4abab938aeaf7fe52c3d P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:36.735291 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet b5981b9676cb4abab938aeaf7fe52c3d with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:36.735546 21526 tablet_replica.cc:330] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:36.735709 21526 raft_consensus.cc:2229] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:36.736080 21526 raft_consensus.cc:2258] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:36.736975 21526 ts_tablet_manager.cc:1875] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:36.739356 21526 ts_tablet_manager.cc:1888] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:36.739495 21526 log.cc:1196] T b5981b9676cb4abab938aeaf7fe52c3d P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/b5981b9676cb4abab938aeaf7fe52c3d
I20240502 20:46:36.740217 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet b5981b9676cb4abab938aeaf7fe52c3d (table rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]) successfully deleted
I20240502 20:46:36.767437 21003 raft_consensus.cc:1050] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:36.768020 21003 consensus_queue.cc:237] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:36.769493 15891 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.769502 17639 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.770321 18676 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.770433 21596 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.770812 21596 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.771085 21592 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.773890 21596 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.774973 17639 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.774996 15894 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.777472 18676 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.777698 15486 catalog_manager.cc:5484] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:36.781508 15632 consensus_queue.cc:237] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:36.783783 18676 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.783857 17639 raft_consensus.cc:1261] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.784269 21003 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.784608 21003 consensus_queue.cc:1035] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.786255 21003 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.786762 17639 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.787174 18676 raft_consensus.cc:2932] T 75f842e898b845f69b2617cc539b00db P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:36.787972 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 75f842e898b845f69b2617cc539b00db with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:36.789630 15485 catalog_manager.cc:5484] T 75f842e898b845f69b2617cc539b00db P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:36.792951 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet 75f842e898b845f69b2617cc539b00db with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:36.793388 21654 tablet_replica.cc:330] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:36.793541 21654 raft_consensus.cc:2229] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:36.793707 21654 raft_consensus.cc:2258] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:36.794467 21654 ts_tablet_manager.cc:1875] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:36.796716 21654 ts_tablet_manager.cc:1888] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:36.796809 21654 log.cc:1196] T 75f842e898b845f69b2617cc539b00db P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/75f842e898b845f69b2617cc539b00db
I20240502 20:46:36.797363 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet 75f842e898b845f69b2617cc539b00db (table rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]) successfully deleted
I20240502 20:46:36.831631 16024 consensus_queue.cc:237] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.833312 15762 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:36.833341 17509 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 20:46:36.833957 15959 consensus_peers.cc:485] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 601b3ef7a0e34242a97210ff74c9e8b3. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:36.834245 21501 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:36.834805 21508 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:36.835595 21596 raft_consensus.cc:1050] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:36.836055 21596 consensus_queue.cc:237] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:36.836928 21256 raft_consensus.cc:1050] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:36.837342 21256 consensus_queue.cc:237] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:36.837481 21508 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:36.837669 17639 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.838093 21003 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.838948 17509 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.838973 17377 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.839298 21256 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.839666 21256 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.840335 15762 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.840338 17508 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.840720 15763 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:36.841327 20786 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.841660 20786 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.842798 15490 catalog_manager.cc:5484] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:36.843470 21003 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.843981 15763 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.845743 17639 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.847522 17508 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:36.848269 17509 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.848326 15485 catalog_manager.cc:5484] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 reported cstate change: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.854646 15632 consensus_queue.cc:237] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:36.854882 16024 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.855531 21686 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.856513 17639 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.857066 21592 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.857621 21690 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.858666 17378 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.860889 17508 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.860971 20786 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.861428 17639 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.863229 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 60c7001f651848b788926cde86a3c0f6 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:36.864092 15481 catalog_manager.cc:5484] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:36.864634 15484 catalog_manager.cc:5484] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:36.864753 16024 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.865394 17509 raft_consensus.cc:1261] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.868023 20786 consensus_queue.cc:1035] T 60c7001f651848b788926cde86a3c0f6 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.868702 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 60c7001f651848b788926cde86a3c0f6 with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:36.868955 21526 tablet_replica.cc:330] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:36.869098 21526 raft_consensus.cc:2229] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:36.868992 17509 raft_consensus.cc:2932] T 60c7001f651848b788926cde86a3c0f6 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.869251 21526 raft_consensus.cc:2258] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:36.869879 21526 ts_tablet_manager.cc:1875] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:36.872144 21526 ts_tablet_manager.cc:1888] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:36.872246 21526 log.cc:1196] T 60c7001f651848b788926cde86a3c0f6 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/60c7001f651848b788926cde86a3c0f6
I20240502 20:46:36.872259 15763 consensus_queue.cc:237] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:36.872736 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 60c7001f651848b788926cde86a3c0f6 (table rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]) successfully deleted
I20240502 20:46:36.873404 17508 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.873688 17377 raft_consensus.cc:1261] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 0dfebe1fc59a48debca946314a5e3d0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.874061 21692 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.874235 21686 consensus_queue.cc:1035] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.875974 21692 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.877337 17508 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.877766 15894 consensus_queue.cc:237] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:36.877919 17377 raft_consensus.cc:2932] T 281af65f89524fdeba2c97322a482009 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:36.879299 17378 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:36.879868 21563 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:36.879906 15475 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 281af65f89524fdeba2c97322a482009 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20240502 20:46:36.880327 15828 consensus_peers.cc:485] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89f653589b534402b873b05f9c15bf24. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:36.880256 15485 catalog_manager.cc:5484] T 281af65f89524fdeba2c97322a482009 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 8 to 9, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "0dfebe1fc59a48debca946314a5e3d0a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:36.880956 15763 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:36.881379 21569 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:36.882258 21569 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:36.882714 17378 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:36.884734 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet 281af65f89524fdeba2c97322a482009 with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:36.885197 15484 catalog_manager.cc:5484] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:36.886459 21709 tablet_replica.cc:330] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:36.886654 21709 raft_consensus.cc:2229] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:36.886952 21709 raft_consensus.cc:2258] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:36.886822 15763 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:36.888525 21709 ts_tablet_manager.cc:1875] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:36.890950 21709 ts_tablet_manager.cc:1888] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:36.891019 21709 log.cc:1196] T 281af65f89524fdeba2c97322a482009 P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/281af65f89524fdeba2c97322a482009
I20240502 20:46:36.891580 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet 281af65f89524fdeba2c97322a482009 (table rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]) successfully deleted
I20240502 20:46:36.904207 21501 raft_consensus.cc:1050] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:36.904692 21501 consensus_queue.cc:237] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:36.906103 17508 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.906230 15894 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.906324 17639 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.906890 20689 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.907264 20689 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.908924 21508 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.910945 20543 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.912159 17639 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.915244 15891 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.915455 15484 catalog_manager.cc:5484] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:36.919512 17508 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.921164 16024 consensus_queue.cc:237] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:36.922546 17639 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.922955 17508 raft_consensus.cc:1261] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.923172 21508 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.923698 21508 consensus_queue.cc:1035] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20240502 20:46:36.925897 21501 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.926666 17639 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.926820 21596 raft_consensus.cc:1050] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:36.927264 21596 consensus_queue.cc:237] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:36.928732 15891 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.929008 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1694de56984a4ca78f9dabaaca2677de with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:36.929054 17771 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.929129 21003 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.929625 21003 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.929596 15481 catalog_manager.cc:5484] T 1694de56984a4ca78f9dabaaca2677de P 47eb2a910e8949308b382a74c55030b5 reported cstate change: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.929994 17508 raft_consensus.cc:2932] T 1694de56984a4ca78f9dabaaca2677de P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.930961 17639 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.931638 21003 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.932618 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet 1694de56984a4ca78f9dabaaca2677de with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:36.932943 21654 tablet_replica.cc:330] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:36.933099 21654 raft_consensus.cc:2229] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:36.933307 21654 raft_consensus.cc:2258] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:36.933737 21003 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.934075 21654 ts_tablet_manager.cc:1875] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:36.935683 15891 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.936304 15485 catalog_manager.cc:5484] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:36.936600 21654 ts_tablet_manager.cc:1888] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:36.936669 21654 log.cc:1196] T 1694de56984a4ca78f9dabaaca2677de P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/1694de56984a4ca78f9dabaaca2677de
I20240502 20:46:36.938153 17639 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.938238 17771 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.938915 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet 1694de56984a4ca78f9dabaaca2677de (table rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]) successfully deleted
I20240502 20:46:36.953972 15632 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581"
dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:38102
I20240502 20:46:36.954160 15632 raft_consensus.cc:595] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:36.963811 21563 raft_consensus.cc:1050] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:36.964251 21563 consensus_queue.cc:237] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:36.965579 17639 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.965703 17378 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.966042 21091 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.966092 15632 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.966200 21569 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.966519 21563 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.969204 21563 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.969565 17639 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.972189 21592 raft_consensus.cc:1050] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:36.972550 21592 consensus_queue.cc:237] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:36.972702 15484 catalog_manager.cc:5484] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5 reported cstate change: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.974511 15763 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.974862 17771 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.975669 21003 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.975821 17377 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.976989 21003 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.977567 15632 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.980093 21003 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:36.980672 17378 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:36.981083 21592 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:36.982034 15763 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:36.982461 17378 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:36.982906 15891 consensus_queue.cc:237] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:36.984236 17377 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.984537 15481 catalog_manager.cc:5484] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:36.984757 17639 raft_consensus.cc:1261] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:36.984782 21563 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.985487 17771 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:36.986402 21569 consensus_queue.cc:1035] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:36.986966 21569 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.988471 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a87847912eaa4602abf9bd9cf2c698fd with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:36.989288 17377 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.989792 15490 catalog_manager.cc:5484] T a87847912eaa4602abf9bd9cf2c698fd P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 8 to 9, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:36.990904 17639 raft_consensus.cc:2932] T a87847912eaa4602abf9bd9cf2c698fd P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:36.995026 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet a87847912eaa4602abf9bd9cf2c698fd with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:36.995321 21589 tablet_replica.cc:330] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:36.995471 21589 raft_consensus.cc:2229] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:36.995669 21589 raft_consensus.cc:2258] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:36.996546 21589 ts_tablet_manager.cc:1875] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:36.998538 21589 ts_tablet_manager.cc:1888] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:36.998606 21589 log.cc:1196] T a87847912eaa4602abf9bd9cf2c698fd P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/a87847912eaa4602abf9bd9cf2c698fd
I20240502 20:46:36.999068 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet a87847912eaa4602abf9bd9cf2c698fd (table rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]) successfully deleted
I20240502 20:46:37.032600 20543 raft_consensus.cc:1050] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:37.033010 20543 consensus_queue.cc:237] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:37.034330 17771 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.034636 17508 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.034981 15891 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.035100 21508 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.035310 21501 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.035591 21508 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.037524 21501 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.037909 15891 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.039134 17508 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.040402 17771 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.041203 15485 catalog_manager.cc:5484] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:37.044673 21570 raft_consensus.cc:1050] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:37.045111 21570 consensus_queue.cc:237] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:37.046674 17639 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.047017 16024 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.047359 17508 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.047649 21569 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.047972 21569 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.049306 21569 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.050982 21091 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:37.052707 17508 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:37.052889 17639 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:37.055312 16024 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:37.056443 15484 catalog_manager.cc:5484] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 reported cstate change: config changed from index 7 to 8, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:37.058645 21596 raft_consensus.cc:1050] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:37.059070 21596 consensus_queue.cc:237] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:37.060671 15891 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.060693 17377 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.061220 21592 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.061419 20786 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.062884 18676 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.063513 21596 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.065394 20786 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:37.065901 17377 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:37.066159 18676 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:37.068989 15484 catalog_manager.cc:5484] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:37.070309 15632 consensus_queue.cc:237] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:37.070662 15891 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:37.071936 17771 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:37.072445 21003 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:37.072738 15891 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:37.073359 20786 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20240502 20:46:37.074007 15566 consensus_peers.cc:485] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a46ac0be3ab49e185c300eeedb8cd39. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:37.074805 20786 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:37.076756 17771 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:37.077010 15632 consensus_queue.cc:237] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:37.078868 17377 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:37.079433 21003 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:37.080015 15891 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:37.080585 15490 catalog_manager.cc:5484] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:37.081215 18676 raft_consensus.cc:1261] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:37.081619 21003 consensus_queue.cc:1035] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:37.082765 21003 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:37.083467 17377 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:37.085281 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet effe8b25103e4fd6abafde8c7b425165 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:37.086066 15481 catalog_manager.cc:5484] T effe8b25103e4fd6abafde8c7b425165 P 049bb73c1cda4f3a95adddfc2a6ea66f reported cstate change: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:37.088676 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet effe8b25103e4fd6abafde8c7b425165 with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:37.088891 21654 tablet_replica.cc:330] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:37.089036 21654 raft_consensus.cc:2229] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:37.088896 18676 raft_consensus.cc:2932] T effe8b25103e4fd6abafde8c7b425165 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:37.089213 21654 raft_consensus.cc:2258] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:37.089929 21654 ts_tablet_manager.cc:1875] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:37.092106 21654 ts_tablet_manager.cc:1888] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:37.092173 21654 log.cc:1196] T effe8b25103e4fd6abafde8c7b425165 P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/effe8b25103e4fd6abafde8c7b425165
I20240502 20:46:37.092661 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet effe8b25103e4fd6abafde8c7b425165 (table rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]) successfully deleted
I20240502 20:46:37.118861 15632 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581"
dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:38164
I20240502 20:46:37.119019 15632 raft_consensus.cc:595] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.129465 20689 raft_consensus.cc:1050] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 389fb867bde04f9980fe702dc1111079 to VOTER
I20240502 20:46:37.129894 20689 consensus_queue.cc:237] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:37.131310 17771 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.131364 17377 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.131453 15891 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.131805 21508 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.131978 20689 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.132158 20543 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.134083 20689 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.134546 15891 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.136291 17377 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.136978 15481 catalog_manager.cc:5484] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:37.137465 17771 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 389fb867bde04f9980fe702dc1111079 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.143350 16024 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29"
dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:34692
I20240502 20:46:37.143499 16024 raft_consensus.cc:595] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.161870 16024 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "15214db73de54afba83b983bc2865948"
dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:34716
I20240502 20:46:37.162016 16024 raft_consensus.cc:595] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.174006 20786 raft_consensus.cc:1050] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 47eb2a910e8949308b382a74c55030b5 to VOTER
I20240502 20:46:37.174471 20786 consensus_queue.cc:237] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:37.175871 17639 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.176005 17508 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.176307 20786 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.176513 21003 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.176962 15763 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:37.178709 20786 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:37.178579 21003 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:37.179170 17639 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:37.179942 15763 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:37.182587 15490 catalog_manager.cc:5484] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:37.183194 17508 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 47eb2a910e8949308b382a74c55030b5 (127.9.82.135) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:37.187156 15891 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "86ff3421109a484f869fd29f63392186"
dest_uuid: "f7df976329f944319cef90e7116dfa96"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:43656
I20240502 20:46:37.187343 15891 raft_consensus.cc:595] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.195518 16024 consensus_queue.cc:237] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:37.197018 17771 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:37.197167 15763 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:46:37.197432 21508 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20240502 20:46:37.197633 15959 consensus_peers.cc:485] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 0eff851f85a5413c8847f817e3742379 (127.9.82.137:37247): Couldn't send request to peer 0eff851f85a5413c8847f817e3742379. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1fcf1751e8f4b978ecbdb2535b7e1f1. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:37.197803 21508 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:46:37.199295 21501 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:37.199855 17771 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:37.201520 15763 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } } }
I20240502 20:46:37.202333 15481 catalog_manager.cc:5484] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 6 to 7, NON_VOTER 0eff851f85a5413c8847f817e3742379 (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:37.233332 21946 ts_tablet_manager.cc:902] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:37.233904 21946 tablet_copy_client.cc:308] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:37.234488 16044 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 601b3ef7a0e34242a97210ff74c9e8b3 from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:60207)
I20240502 20:46:37.234598 16044 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 601b3ef7a0e34242a97210ff74c9e8b3 from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:60207: session id = 0eff851f85a5413c8847f817e3742379-601b3ef7a0e34242a97210ff74c9e8b3
I20240502 20:46:37.235530 16044 tablet_copy_source_session.cc:205] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:37.236523 21946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601b3ef7a0e34242a97210ff74c9e8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:37.236852 15632 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed"
dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:38224
I20240502 20:46:37.236977 15632 raft_consensus.cc:595] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.239187 21946 tablet_copy_client.cc:783] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:37.239356 21946 tablet_copy_client.cc:647] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:37.240466 21951 tablet_copy_client.cc:1002] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:37.247555 15632 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581"
dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:38234
I20240502 20:46:37.247709 15632 raft_consensus.cc:595] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.264482 16024 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29"
dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:34738
I20240502 20:46:37.264642 16024 raft_consensus.cc:595] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.274327 16024 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "15214db73de54afba83b983bc2865948"
dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:34748
I20240502 20:46:37.274447 16024 raft_consensus.cc:595] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.289408 15891 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "86ff3421109a484f869fd29f63392186"
dest_uuid: "f7df976329f944319cef90e7116dfa96"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:43690
I20240502 20:46:37.289547 15891 raft_consensus.cc:595] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.297533 22002 ts_tablet_manager.cc:902] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:37.298143 22002 tablet_copy_client.cc:308] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:37.298666 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet 167efd92157a42ec84ea1cfb1de4a15c from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:58375)
I20240502 20:46:37.298754 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet 167efd92157a42ec84ea1cfb1de4a15c from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:58375: session id = 0eff851f85a5413c8847f817e3742379-167efd92157a42ec84ea1cfb1de4a15c
I20240502 20:46:37.299538 15914 tablet_copy_source_session.cc:205] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:37.300405 22002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 167efd92157a42ec84ea1cfb1de4a15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:37.301580 22007 ts_tablet_manager.cc:902] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885)
I20240502 20:46:37.302129 22007 tablet_copy_client.cc:308] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:40885
I20240502 20:46:37.302623 15914 tablet_copy_service.cc:140] P f7df976329f944319cef90e7116dfa96: Received BeginTabletCopySession request for tablet 89f653589b534402b873b05f9c15bf24 from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:58375)
I20240502 20:46:37.302724 22002 tablet_copy_client.cc:783] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:37.302728 15914 tablet_copy_service.cc:161] P f7df976329f944319cef90e7116dfa96: Beginning new tablet copy session on tablet 89f653589b534402b873b05f9c15bf24 from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:58375: session id = 0eff851f85a5413c8847f817e3742379-89f653589b534402b873b05f9c15bf24
I20240502 20:46:37.302883 22002 tablet_copy_client.cc:647] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:37.303428 15914 tablet_copy_source_session.cc:205] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:37.304117 22006 tablet_copy_client.cc:1002] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:37.304375 22007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f653589b534402b873b05f9c15bf24. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:37.306219 22007 tablet_copy_client.cc:783] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:37.306448 22007 tablet_copy_client.cc:647] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:37.307703 22009 tablet_copy_client.cc:1002] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:37.351640 21596 raft_consensus.cc:979] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: : Instructing follower 389fb867bde04f9980fe702dc1111079 to start an election
I20240502 20:46:37.351827 21592 raft_consensus.cc:1067] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Signalling peer 389fb867bde04f9980fe702dc1111079 to start an election
I20240502 20:46:37.352437 17771 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581"
dest_uuid: "389fb867bde04f9980fe702dc1111079"
from {username='slave'} at 127.9.82.129:35237
I20240502 20:46:37.352631 17771 raft_consensus.cc:482] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 20:46:37.352739 17771 raft_consensus.cc:3037] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.353621 17771 raft_consensus.cc:504] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:37.354653 17771 leader_election.cc:288] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [CANDIDATE]: Term 2 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733)
I20240502 20:46:37.354923 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581" candidate_uuid: "389fb867bde04f9980fe702dc1111079" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:37.355053 15632 raft_consensus.cc:3032] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Stepping down as leader of term 1
I20240502 20:46:37.355094 15632 raft_consensus.cc:729] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:37.355137 15891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581" candidate_uuid: "389fb867bde04f9980fe702dc1111079" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:37.355283 15891 raft_consensus.cc:3037] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.355254 15632 consensus_queue.cc:260] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:37.355475 15632 raft_consensus.cc:3037] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.356456 15891 raft_consensus.cc:2454] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389fb867bde04f9980fe702dc1111079 in term 2.
I20240502 20:46:37.356473 15632 raft_consensus.cc:2454] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389fb867bde04f9980fe702dc1111079 in term 2.
I20240502 20:46:37.356848 17706 leader_election.cc:302] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 389fb867bde04f9980fe702dc1111079, 8c5f48d02a284d0eb4b1fa3868ab669f, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:37.357045 21404 raft_consensus.cc:2781] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 20:46:37.357263 21404 raft_consensus.cc:686] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 2 LEADER]: Becoming Leader. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Running, Role: LEADER
I20240502 20:46:37.357548 21404 consensus_queue.cc:237] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:37.360124 17639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e16f4c2f41e41eeb40b67b147296581" candidate_uuid: "389fb867bde04f9980fe702dc1111079" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "47eb2a910e8949308b382a74c55030b5"
I20240502 20:46:37.360304 17639 raft_consensus.cc:3037] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.360581 15484 catalog_manager.cc:5484] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 reported cstate change: term changed from 1 to 2, leader changed from 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) to 389fb867bde04f9980fe702dc1111079 (127.9.82.136). New cstate: current_term: 2 leader_uuid: "389fb867bde04f9980fe702dc1111079" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:37.361279 17639 raft_consensus.cc:2454] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389fb867bde04f9980fe702dc1111079 in term 2.
I20240502 20:46:37.448053 21508 raft_consensus.cc:979] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: : Instructing follower 389fb867bde04f9980fe702dc1111079 to start an election
I20240502 20:46:37.448189 21508 raft_consensus.cc:1067] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Signalling peer 389fb867bde04f9980fe702dc1111079 to start an election
I20240502 20:46:37.448805 17771 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29"
dest_uuid: "389fb867bde04f9980fe702dc1111079"
from {username='slave'} at 127.9.82.132:46071
I20240502 20:46:37.448945 17771 raft_consensus.cc:482] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 20:46:37.449023 17771 raft_consensus.cc:3037] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.449899 17771 raft_consensus.cc:504] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:37.450425 17771 leader_election.cc:288] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [CANDIDATE]: Term 2 election: Requested vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373)
I20240502 20:46:37.450830 15891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29" candidate_uuid: "389fb867bde04f9980fe702dc1111079" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:37.450942 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29" candidate_uuid: "389fb867bde04f9980fe702dc1111079" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:37.450999 15891 raft_consensus.cc:3037] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.451066 16024 raft_consensus.cc:3032] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 20:46:37.451104 16024 raft_consensus.cc:729] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:37.451282 16024 consensus_queue.cc:260] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:37.451488 16024 raft_consensus.cc:3037] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.452142 15891 raft_consensus.cc:2454] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389fb867bde04f9980fe702dc1111079 in term 2.
I20240502 20:46:37.452605 16024 raft_consensus.cc:2454] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389fb867bde04f9980fe702dc1111079 in term 2.
I20240502 20:46:37.452912 17706 leader_election.cc:302] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 389fb867bde04f9980fe702dc1111079, 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:37.453088 21404 raft_consensus.cc:2781] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 20:46:37.453205 21404 raft_consensus.cc:686] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 2 LEADER]: Becoming Leader. State: Replica: 389fb867bde04f9980fe702dc1111079, State: Running, Role: LEADER
I20240502 20:46:37.453344 21404 consensus_queue.cc:237] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:37.455394 15484 catalog_manager.cc:5484] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 reported cstate change: term changed from 1 to 2, leader changed from 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) to 389fb867bde04f9980fe702dc1111079 (127.9.82.136). New cstate: current_term: 2 leader_uuid: "389fb867bde04f9980fe702dc1111079" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:37.455641 17508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7460cf8211d24a3d97085d1a36116a29" candidate_uuid: "389fb867bde04f9980fe702dc1111079" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "376b7736472c4bf2836c4303abf8e6c3"
I20240502 20:46:37.455858 17508 raft_consensus.cc:3037] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.456737 17508 raft_consensus.cc:2454] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389fb867bde04f9980fe702dc1111079 in term 2.
I20240502 20:46:37.529364 21569 raft_consensus.cc:979] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: : Instructing follower 47eb2a910e8949308b382a74c55030b5 to start an election
I20240502 20:46:37.529475 21569 raft_consensus.cc:1067] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Signalling peer 47eb2a910e8949308b382a74c55030b5 to start an election
I20240502 20:46:37.530122 17639 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "86ff3421109a484f869fd29f63392186"
dest_uuid: "47eb2a910e8949308b382a74c55030b5"
from {username='slave'} at 127.9.82.131:57541
I20240502 20:46:37.530335 17639 raft_consensus.cc:482] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 20:46:37.530427 17639 raft_consensus.cc:3037] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.531638 17639 raft_consensus.cc:504] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:37.532980 17639 leader_election.cc:288] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [CANDIDATE]: Term 2 election: Requested vote from peers f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885), 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373)
I20240502 20:46:37.533561 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ff3421109a484f869fd29f63392186" candidate_uuid: "47eb2a910e8949308b382a74c55030b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:37.533533 15891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ff3421109a484f869fd29f63392186" candidate_uuid: "47eb2a910e8949308b382a74c55030b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "f7df976329f944319cef90e7116dfa96"
I20240502 20:46:37.533674 16024 raft_consensus.cc:3037] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.533689 15891 raft_consensus.cc:3032] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 20:46:37.533733 15891 raft_consensus.cc:729] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7df976329f944319cef90e7116dfa96, State: Running, Role: LEADER
I20240502 20:46:37.533915 15891 consensus_queue.cc:260] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:37.534101 15891 raft_consensus.cc:3037] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.534390 22042 ts_tablet_manager.cc:902] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245)
I20240502 20:46:37.534790 16024 raft_consensus.cc:2454] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47eb2a910e8949308b382a74c55030b5 in term 2.
I20240502 20:46:37.535140 15891 raft_consensus.cc:2454] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47eb2a910e8949308b382a74c55030b5 in term 2.
I20240502 20:46:37.535148 22042 tablet_copy_client.cc:308] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:34245
I20240502 20:46:37.535622 17575 leader_election.cc:302] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3be8cce319d343fca3df1cf166a55a74, 47eb2a910e8949308b382a74c55030b5, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:37.535660 15652 tablet_copy_service.cc:140] P 8c5f48d02a284d0eb4b1fa3868ab669f: Received BeginTabletCopySession request for tablet 8a46ac0be3ab49e185c300eeedb8cd39 from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:50819)
I20240502 20:46:37.535779 15652 tablet_copy_service.cc:161] P 8c5f48d02a284d0eb4b1fa3868ab669f: Beginning new tablet copy session on tablet 8a46ac0be3ab49e185c300eeedb8cd39 from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:50819: session id = 0eff851f85a5413c8847f817e3742379-8a46ac0be3ab49e185c300eeedb8cd39
I20240502 20:46:37.535962 21408 raft_consensus.cc:2781] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 20:46:37.536173 21408 raft_consensus.cc:686] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 2 LEADER]: Becoming Leader. State: Replica: 47eb2a910e8949308b382a74c55030b5, State: Running, Role: LEADER
I20240502 20:46:37.536489 21408 consensus_queue.cc:237] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:37.536649 15652 tablet_copy_source_session.cc:205] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:37.538443 22042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a46ac0be3ab49e185c300eeedb8cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:37.539156 15484 catalog_manager.cc:5484] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 reported cstate change: term changed from 1 to 2, leader changed from f7df976329f944319cef90e7116dfa96 (127.9.82.131) to 47eb2a910e8949308b382a74c55030b5 (127.9.82.135). New cstate: current_term: 2 leader_uuid: "47eb2a910e8949308b382a74c55030b5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:37.542524 22042 tablet_copy_client.cc:783] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:37.542745 22042 tablet_copy_client.cc:647] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:37.543537 17508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ff3421109a484f869fd29f63392186" candidate_uuid: "47eb2a910e8949308b382a74c55030b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "376b7736472c4bf2836c4303abf8e6c3"
I20240502 20:46:37.543675 17508 raft_consensus.cc:3037] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.544060 22044 tablet_copy_client.cc:1002] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:37.544775 17508 raft_consensus.cc:2454] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47eb2a910e8949308b382a74c55030b5 in term 2.
I20240502 20:46:37.546962 15632 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed"
dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:38266
I20240502 20:46:37.547086 15632 raft_consensus.cc:595] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.564463 21592 raft_consensus.cc:979] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: : Instructing follower 376b7736472c4bf2836c4303abf8e6c3 to start an election
I20240502 20:46:37.564555 21592 raft_consensus.cc:1067] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Signalling peer 376b7736472c4bf2836c4303abf8e6c3 to start an election
I20240502 20:46:37.565038 17508 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed"
dest_uuid: "376b7736472c4bf2836c4303abf8e6c3"
from {username='slave'} at 127.9.82.129:44881
I20240502 20:46:37.565243 17508 raft_consensus.cc:482] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 20:46:37.565318 17508 raft_consensus.cc:3037] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.566351 17508 raft_consensus.cc:504] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:37.567780 15632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed" candidate_uuid: "376b7736472c4bf2836c4303abf8e6c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f"
I20240502 20:46:37.567901 15632 raft_consensus.cc:3032] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Stepping down as leader of term 1
I20240502 20:46:37.567950 15632 raft_consensus.cc:729] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c5f48d02a284d0eb4b1fa3868ab669f, State: Running, Role: LEADER
I20240502 20:46:37.567953 17508 leader_election.cc:288] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [CANDIDATE]: Term 2 election: Requested vote from peers 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245), 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937), 47eb2a910e8949308b382a74c55030b5 (127.9.82.135:34733)
I20240502 20:46:37.568126 15632 consensus_queue.cc:260] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:37.568331 15632 raft_consensus.cc:3037] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.568567 15763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed" candidate_uuid: "376b7736472c4bf2836c4303abf8e6c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "0dfebe1fc59a48debca946314a5e3d0a"
I20240502 20:46:37.568693 15763 raft_consensus.cc:3037] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.569391 15632 raft_consensus.cc:2454] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376b7736472c4bf2836c4303abf8e6c3 in term 2.
I20240502 20:46:37.569787 15763 raft_consensus.cc:2454] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376b7736472c4bf2836c4303abf8e6c3 in term 2.
I20240502 20:46:37.570134 17443 leader_election.cc:302] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0dfebe1fc59a48debca946314a5e3d0a, 376b7736472c4bf2836c4303abf8e6c3, 8c5f48d02a284d0eb4b1fa3868ab669f; no voters:
I20240502 20:46:37.570375 21334 raft_consensus.cc:2781] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 20:46:37.570582 21334 raft_consensus.cc:686] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 2 LEADER]: Becoming Leader. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Running, Role: LEADER
I20240502 20:46:37.570874 21334 consensus_queue.cc:237] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:37.573448 15484 catalog_manager.cc:5484] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 reported cstate change: term changed from 1 to 2, leader changed from 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) to 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134). New cstate: current_term: 2 leader_uuid: "376b7736472c4bf2836c4303abf8e6c3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:37.575227 17639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6521649137d4bab9ecf18c8f81abaed" candidate_uuid: "376b7736472c4bf2836c4303abf8e6c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "47eb2a910e8949308b382a74c55030b5"
I20240502 20:46:37.575363 17639 raft_consensus.cc:3037] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.576404 17639 raft_consensus.cc:2454] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 376b7736472c4bf2836c4303abf8e6c3 in term 2.
I20240502 20:46:37.582546 16024 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "15214db73de54afba83b983bc2865948"
dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:34786
I20240502 20:46:37.582672 16024 raft_consensus.cc:595] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Received request to transfer leadership
I20240502 20:46:37.598562 15632 consensus_queue.cc:237] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:37.599900 17377 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:37.599956 17771 raft_consensus.cc:1261] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:37.600381 21592 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:37.600589 21596 consensus_queue.cc:1035] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:37.602521 21003 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.602989 20689 raft_consensus.cc:979] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: : Instructing follower f7df976329f944319cef90e7116dfa96 to start an election
I20240502 20:46:37.603091 20689 raft_consensus.cc:1067] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Signalling peer f7df976329f944319cef90e7116dfa96 to start an election
I20240502 20:46:37.603384 17771 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.604028 15891 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "15214db73de54afba83b983bc2865948"
dest_uuid: "f7df976329f944319cef90e7116dfa96"
from {username='slave'} at 127.9.82.132:60903
I20240502 20:46:37.604171 15891 raft_consensus.cc:482] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 20:46:37.604228 15891 raft_consensus.cc:3037] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.605072 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:37.605315 15891 raft_consensus.cc:504] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:37.603539 17377 raft_consensus.cc:2932] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:37.605815 15891 leader_election.cc:288] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 2 election: Requested vote from peers 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949), 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363), 389fb867bde04f9980fe702dc1111079 (127.9.82.136:41687)
I20240502 20:46:37.606376 17378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15214db73de54afba83b983bc2865948" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f"
I20240502 20:46:37.606550 17378 raft_consensus.cc:3037] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.606580 16024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15214db73de54afba83b983bc2865948" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "3be8cce319d343fca3df1cf166a55a74"
I20240502 20:46:37.606707 16024 raft_consensus.cc:3032] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 20:46:37.606766 16024 raft_consensus.cc:729] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3be8cce319d343fca3df1cf166a55a74, State: Running, Role: LEADER
I20240502 20:46:37.606900 16024 consensus_queue.cc:260] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:37.607079 16024 raft_consensus.cc:3037] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.607432 17771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15214db73de54afba83b983bc2865948" candidate_uuid: "f7df976329f944319cef90e7116dfa96" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "389fb867bde04f9980fe702dc1111079"
I20240502 20:46:37.607651 17771 raft_consensus.cc:3037] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:37.607664 17378 raft_consensus.cc:2454] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 2.
I20240502 20:46:37.608273 16024 raft_consensus.cc:2454] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 2.
I20240502 20:46:37.608645 15484 catalog_manager.cc:5484] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:37.608856 15830 leader_election.cc:302] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 049bb73c1cda4f3a95adddfc2a6ea66f, 3be8cce319d343fca3df1cf166a55a74, f7df976329f944319cef90e7116dfa96; no voters:
I20240502 20:46:37.609084 21569 raft_consensus.cc:2781] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 20:46:37.609186 21569 raft_consensus.cc:686] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 2 LEADER]: Becoming Leader. State: Replica: f7df976329f944319cef90e7116dfa96, State: Running, Role: LEADER
I20240502 20:46:37.609334 17771 raft_consensus.cc:2454] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7df976329f944319cef90e7116dfa96 in term 2.
I20240502 20:46:37.609359 21569 consensus_queue.cc:237] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:37.611191 15485 catalog_manager.cc:5484] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 reported cstate change: term changed from 1 to 2, leader changed from 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) to f7df976329f944319cef90e7116dfa96 (127.9.82.131). New cstate: current_term: 2 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:37.612079 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:37.612481 22091 tablet_replica.cc:330] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:37.612607 22091 raft_consensus.cc:2229] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:37.612810 22091 raft_consensus.cc:2258] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:37.613792 22091 ts_tablet_manager.cc:1875] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:37.615535 22091 ts_tablet_manager.cc:1888] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:37.615604 22091 log.cc:1196] T 1eb03dc9cdf04f7a9ef9b96da66ab7dc P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/1eb03dc9cdf04f7a9ef9b96da66ab7dc
I20240502 20:46:37.616204 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc (table rebalance_test_table_4 [id=e864aa9be8a24778926a86da602a64c7]) successfully deleted
I20240502 20:46:37.697139 22092 ts_tablet_manager.cc:902] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:37.697656 22092 tablet_copy_client.cc:308] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:37.698179 16044 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 from peer 0eff851f85a5413c8847f817e3742379 ({username='slave'} at 127.9.82.137:60207)
I20240502 20:46:37.698280 16044 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 from peer 0eff851f85a5413c8847f817e3742379 at {username='slave'} at 127.9.82.137:60207: session id = 0eff851f85a5413c8847f817e3742379-d1fcf1751e8f4b978ecbdb2535b7e1f1
I20240502 20:46:37.699093 16044 tablet_copy_source_session.cc:205] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:37.699947 22092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:37.702111 22092 tablet_copy_client.cc:783] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:37.702277 22092 tablet_copy_client.cc:647] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:37.703259 22093 tablet_copy_client.cc:1002] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:37.764604 15891 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:37.765172 21404 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:37.818847 17639 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:37.820488 21404 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:37.823767 15632 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:37.824812 22014 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:37.833534 17771 consensus_queue.cc:237] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:37.835006 17639 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:37.835217 15891 raft_consensus.cc:1261] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:37.835444 21404 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:37.836007 22118 consensus_queue.cc:1035] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:37.837090 21404 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 389fb867bde04f9980fe702dc1111079 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:37.837486 17639 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:37.839946 15891 raft_consensus.cc:2932] T 3e16f4c2f41e41eeb40b67b147296581 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:37.840391 15485 catalog_manager.cc:5484] T 3e16f4c2f41e41eeb40b67b147296581 P 47eb2a910e8949308b382a74c55030b5 reported cstate change: config changed from index 8 to 10, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 2 leader_uuid: "389fb867bde04f9980fe702dc1111079" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:37.843122 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e16f4c2f41e41eeb40b67b147296581 with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:37.843536 22133 tablet_replica.cc:330] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:37.843683 22133 raft_consensus.cc:2229] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:37.843827 22133 raft_consensus.cc:2258] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:37.844400 22133 ts_tablet_manager.cc:1875] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:37.846218 22133 ts_tablet_manager.cc:1888] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 20:46:37.846293 22133 log.cc:1196] T 3e16f4c2f41e41eeb40b67b147296581 P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/3e16f4c2f41e41eeb40b67b147296581
I20240502 20:46:37.846793 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet 3e16f4c2f41e41eeb40b67b147296581 (table rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]) successfully deleted
I20240502 20:46:37.850034 15891 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:37.850435 22118 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:37.865288 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 3e16f4c2f41e41eeb40b67b147296581 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:37.893716 16024 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:37.894219 21404 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:37.896975 17508 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:37.898864 22118 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.061843 17508 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Refusing update from remote peer 47eb2a910e8949308b382a74c55030b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:38.062459 21408 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.067272 16024 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:38.067737 21570 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.075914 17639 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Refusing update from remote peer 376b7736472c4bf2836c4303abf8e6c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:38.076452 21334 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.085332 16024 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Refusing update from remote peer 47eb2a910e8949308b382a74c55030b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:38.085820 21408 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.088657 15891 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Refusing update from remote peer 47eb2a910e8949308b382a74c55030b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:38.089093 22210 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.096287 17639 consensus_queue.cc:237] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:38.097532 17508 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Refusing update from remote peer 47eb2a910e8949308b382a74c55030b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:38.097529 16024 raft_consensus.cc:1261] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Refusing update from remote peer 47eb2a910e8949308b382a74c55030b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:38.097972 22211 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:38.098165 22210 consensus_queue.cc:1035] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:38.099954 21408 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 47eb2a910e8949308b382a74c55030b5 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:38.100699 16024 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:38.102121 17508 raft_consensus.cc:2932] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:38.104852 15485 catalog_manager.cc:5484] T 86ff3421109a484f869fd29f63392186 P 376b7736472c4bf2836c4303abf8e6c3 reported cstate change: config changed from index 8 to 10, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 2 leader_uuid: "47eb2a910e8949308b382a74c55030b5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:38.107537 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet 86ff3421109a484f869fd29f63392186 with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:38.107923 22213 tablet_replica.cc:330] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:38.108104 22213 raft_consensus.cc:2229] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:38.108232 22213 raft_consensus.cc:2258] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:38.108855 22213 ts_tablet_manager.cc:1875] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:38.110630 22213 ts_tablet_manager.cc:1888] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 20:46:38.110699 22213 log.cc:1196] T 86ff3421109a484f869fd29f63392186 P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/86ff3421109a484f869fd29f63392186
I20240502 20:46:38.111245 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet 86ff3421109a484f869fd29f63392186 (table rebalance_test_table_0 [id=e73b1e0ab1634880922c9a89ef03f462]) successfully deleted
I20240502 20:46:38.125347 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 86ff3421109a484f869fd29f63392186 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:38.159714 17771 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 2 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:38.160197 21569 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.163575 17378 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 2 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:38.164664 21569 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.171204 15763 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 2 FOLLOWER]: Refusing update from remote peer 376b7736472c4bf2836c4303abf8e6c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:38.171505 15632 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 2 FOLLOWER]: Refusing update from remote peer 376b7736472c4bf2836c4303abf8e6c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 20:46:38.171671 21334 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.172042 21334 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:38.183290 17508 consensus_queue.cc:237] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } }
I20240502 20:46:38.184659 15763 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 2 FOLLOWER]: Refusing update from remote peer 376b7736472c4bf2836c4303abf8e6c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:38.184676 17639 raft_consensus.cc:1261] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Refusing update from remote peer 376b7736472c4bf2836c4303abf8e6c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:38.185158 22229 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:38.185535 22070 consensus_queue.cc:1035] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:38.187315 21334 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 376b7736472c4bf2836c4303abf8e6c3 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:38.187783 17639 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 47eb2a910e8949308b382a74c55030b5 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:38.188377 15763 raft_consensus.cc:2932] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:38.189277 15475 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a6521649137d4bab9ecf18c8f81abaed with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:38.191533 15485 catalog_manager.cc:5484] T a6521649137d4bab9ecf18c8f81abaed P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 8 to 10, VOTER 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129) evicted. New cstate: current_term: 2 leader_uuid: "376b7736472c4bf2836c4303abf8e6c3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "47eb2a910e8949308b382a74c55030b5" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 34733 } attrs { promote: false } } }
I20240502 20:46:38.194101 15610 tablet_service.cc:1514] Processing DeleteTablet for tablet a6521649137d4bab9ecf18c8f81abaed with delete_type TABLET_DATA_TOMBSTONED (TS 8c5f48d02a284d0eb4b1fa3868ab669f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:44572
I20240502 20:46:38.194754 22133 tablet_replica.cc:330] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: stopping tablet replica
I20240502 20:46:38.194919 22133 raft_consensus.cc:2229] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:38.195067 22133 raft_consensus.cc:2258] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:38.196110 22133 ts_tablet_manager.cc:1875] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:38.197988 22133 ts_tablet_manager.cc:1888] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 20:46:38.198078 22133 log.cc:1196] T a6521649137d4bab9ecf18c8f81abaed P 8c5f48d02a284d0eb4b1fa3868ab669f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/a6521649137d4bab9ecf18c8f81abaed
I20240502 20:46:38.198690 15477 catalog_manager.cc:4830] TS 8c5f48d02a284d0eb4b1fa3868ab669f (127.9.82.129:34245): tablet a6521649137d4bab9ecf18c8f81abaed (table rebalance_test_table_3 [id=2273b6f283b247f59796124e1bcdfd7c]) successfully deleted
I20240502 20:46:38.517455 17771 consensus_queue.cc:237] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:38.518674 17508 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:38.518774 15891 raft_consensus.cc:1261] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Refusing update from remote peer 389fb867bde04f9980fe702dc1111079: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:38.519318 22336 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:38.519537 22337 consensus_queue.cc:1035] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:38.521155 22336 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 389fb867bde04f9980fe702dc1111079 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:38.521521 15891 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P f7df976329f944319cef90e7116dfa96 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:38.521912 17508 raft_consensus.cc:2932] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:38.524775 15484 catalog_manager.cc:5484] T 7460cf8211d24a3d97085d1a36116a29 P 376b7736472c4bf2836c4303abf8e6c3 reported cstate change: config changed from index 8 to 10, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 2 leader_uuid: "389fb867bde04f9980fe702dc1111079" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:38.525779 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 7460cf8211d24a3d97085d1a36116a29 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:38.527743 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet 7460cf8211d24a3d97085d1a36116a29 with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:38.528133 22338 tablet_replica.cc:330] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:38.528307 22338 raft_consensus.cc:2229] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:38.528426 22338 raft_consensus.cc:2258] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:38.528999 22338 ts_tablet_manager.cc:1875] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:38.531126 22338 ts_tablet_manager.cc:1888] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 20:46:38.531231 22338 log.cc:1196] T 7460cf8211d24a3d97085d1a36116a29 P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/7460cf8211d24a3d97085d1a36116a29
I20240502 20:46:38.533130 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet 7460cf8211d24a3d97085d1a36116a29 (table rebalance_test_table_8 [id=bb65c3d053184307ba090fab5698e86d]) successfully deleted
I20240502 20:46:38.720388 15891 consensus_queue.cc:237] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } }
I20240502 20:46:38.721669 17378 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 2 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:38.721668 17771 raft_consensus.cc:1261] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 2 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 20:46:38.722081 21569 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:38.722270 21563 consensus_queue.cc:1035] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:38.723938 21570 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:38.724370 17771 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 389fb867bde04f9980fe702dc1111079 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:38.726215 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 15214db73de54afba83b983bc2865948 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:38.726099 17378 raft_consensus.cc:2932] T 15214db73de54afba83b983bc2865948 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } }
I20240502 20:46:38.726814 15485 catalog_manager.cc:5484] T 15214db73de54afba83b983bc2865948 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 8 to 10, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 2 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:38.729478 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet 15214db73de54afba83b983bc2865948 with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:38.729871 22338 tablet_replica.cc:330] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:38.730018 22338 raft_consensus.cc:2229] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:38.730124 22338 raft_consensus.cc:2258] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:38.730865 22338 ts_tablet_manager.cc:1875] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:38.732859 22338 ts_tablet_manager.cc:1888] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 20:46:38.732935 22338 log.cc:1196] T 15214db73de54afba83b983bc2865948 P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/15214db73de54afba83b983bc2865948
I20240502 20:46:38.733498 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet 15214db73de54afba83b983bc2865948 (table rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]) successfully deleted
I20240502 20:46:38.740764 21946 tablet_copy_client.cc:523] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:38.742296 21946 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:38.765684 21946 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:38.765976 21946 tablet_bootstrap.cc:492] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:38.766170 21946 ts_tablet_manager.cc:1367] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.024s user 0.022s sys 0.000s
I20240502 20:46:38.766664 21946 raft_consensus.cc:348] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:38.766780 21946 raft_consensus.cc:729] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:38.766893 21946 consensus_queue.cc:260] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:38.767246 21946 ts_tablet_manager.cc:1398] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:46:38.767819 16044 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-601b3ef7a0e34242a97210ff74c9e8b3 received from {username='slave'} at 127.9.82.137:60207
I20240502 20:46:38.767904 16044 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 0eff851f85a5413c8847f817e3742379-601b3ef7a0e34242a97210ff74c9e8b3 on tablet 601b3ef7a0e34242a97210ff74c9e8b3 with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:38.804474 22002 tablet_copy_client.cc:523] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:38.806183 22002 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:38.808032 22007 tablet_copy_client.cc:523] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:38.809180 22007 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:38.826364 22002 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:38.826709 22002 tablet_bootstrap.cc:492] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:38.826896 22002 ts_tablet_manager.cc:1367] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.021s user 0.019s sys 0.000s
I20240502 20:46:38.827297 22002 raft_consensus.cc:348] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:38.827418 22002 raft_consensus.cc:729] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:38.827571 22002 consensus_queue.cc:260] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:38.827863 22002 ts_tablet_manager.cc:1398] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:46:38.828389 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-167efd92157a42ec84ea1cfb1de4a15c received from {username='slave'} at 127.9.82.137:58375
I20240502 20:46:38.828476 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 0eff851f85a5413c8847f817e3742379-167efd92157a42ec84ea1cfb1de4a15c on tablet 167efd92157a42ec84ea1cfb1de4a15c with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:38.829835 22007 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:38.830142 22007 tablet_bootstrap.cc:492] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:38.830312 22007 ts_tablet_manager.cc:1367] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.005s
I20240502 20:46:38.830663 22007 raft_consensus.cc:348] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:38.830762 22007 raft_consensus.cc:729] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:38.830927 22007 consensus_queue.cc:260] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:38.831301 22007 ts_tablet_manager.cc:1398] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:46:38.831760 15914 tablet_copy_service.cc:342] P f7df976329f944319cef90e7116dfa96: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-89f653589b534402b873b05f9c15bf24 received from {username='slave'} at 127.9.82.137:58375
I20240502 20:46:38.831840 15914 tablet_copy_service.cc:433] P f7df976329f944319cef90e7116dfa96: ending tablet copy session 0eff851f85a5413c8847f817e3742379-89f653589b534402b873b05f9c15bf24 on tablet 89f653589b534402b873b05f9c15bf24 with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:38.895350 18675 raft_consensus.cc:1203] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:39.044447 22042 tablet_copy_client.cc:523] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:39.045982 22042 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:39.065639 22042 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:39.065932 22042 tablet_bootstrap.cc:492] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:39.066116 22042 ts_tablet_manager.cc:1367] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.004s
I20240502 20:46:39.066635 22042 raft_consensus.cc:348] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:39.066767 22042 raft_consensus.cc:729] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:39.066884 22042 consensus_queue.cc:260] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:39.067160 22042 ts_tablet_manager.cc:1398] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:39.067806 15652 tablet_copy_service.cc:342] P 8c5f48d02a284d0eb4b1fa3868ab669f: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-8a46ac0be3ab49e185c300eeedb8cd39 received from {username='slave'} at 127.9.82.137:50819
I20240502 20:46:39.067886 15652 tablet_copy_service.cc:433] P 8c5f48d02a284d0eb4b1fa3868ab669f: ending tablet copy session 0eff851f85a5413c8847f817e3742379-8a46ac0be3ab49e185c300eeedb8cd39 on tablet 8a46ac0be3ab49e185c300eeedb8cd39 with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:39.125000 18675 raft_consensus.cc:1203] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:39.196234 18675 raft_consensus.cc:1203] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:39.203588 22092 tablet_copy_client.cc:523] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:39.204982 22092 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: Bootstrap starting.
I20240502 20:46:39.225253 22092 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:39.225876 22092 tablet_bootstrap.cc:492] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: Bootstrap complete.
I20240502 20:46:39.226083 22092 ts_tablet_manager.cc:1367] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: Time spent bootstrapping tablet: real 0.021s user 0.021s sys 0.000s
I20240502 20:46:39.226475 22092 raft_consensus.cc:348] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:39.226617 22092 raft_consensus.cc:729] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0eff851f85a5413c8847f817e3742379, State: Initialized, Role: LEARNER
I20240502 20:46:39.226722 22092 consensus_queue.cc:260] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: true } }
I20240502 20:46:39.227027 22092 ts_tablet_manager.cc:1398] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:39.227581 16044 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 0eff851f85a5413c8847f817e3742379-d1fcf1751e8f4b978ecbdb2535b7e1f1 received from {username='slave'} at 127.9.82.137:60207
I20240502 20:46:39.227675 16044 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 0eff851f85a5413c8847f817e3742379-d1fcf1751e8f4b978ecbdb2535b7e1f1 on tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 with peer 0eff851f85a5413c8847f817e3742379
I20240502 20:46:39.251449 18675 raft_consensus.cc:1203] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:39.269737 18675 raft_consensus.cc:1203] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 20:46:39.390002 22459 raft_consensus.cc:1050] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:39.390484 22459 consensus_queue.cc:237] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.392166 17378 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.392364 15763 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.392395 18675 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.392814 21563 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.393075 21570 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.393318 22459 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.395243 22459 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.395699 18675 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.396260 15763 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.397300 17378 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.399152 15490 catalog_manager.cc:5484] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.403915 15891 consensus_queue.cc:237] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.404985 18675 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.405054 17378 raft_consensus.cc:1261] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.405437 21563 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.405927 21563 consensus_queue.cc:1035] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.407246 22459 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.407792 17378 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.408900 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 89f653589b534402b873b05f9c15bf24 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:39.409484 18675 raft_consensus.cc:2932] T 89f653589b534402b873b05f9c15bf24 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.410285 15485 catalog_manager.cc:5484] T 89f653589b534402b873b05f9c15bf24 P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:39.413287 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 89f653589b534402b873b05f9c15bf24 with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:39.413726 22468 tablet_replica.cc:330] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:39.413980 22468 raft_consensus.cc:2229] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:39.414197 22468 raft_consensus.cc:2258] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:39.415032 22468 ts_tablet_manager.cc:1875] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:39.417085 22468 ts_tablet_manager.cc:1888] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:39.417158 22468 log.cc:1196] T 89f653589b534402b873b05f9c15bf24 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/89f653589b534402b873b05f9c15bf24
I20240502 20:46:39.417646 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 89f653589b534402b873b05f9c15bf24 (table rebalance_test_table_5 [id=5437bbd1e7944fccbba218be1ffb750a]) successfully deleted
I20240502 20:46:39.634260 22459 raft_consensus.cc:1050] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:39.634752 22459 consensus_queue.cc:237] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.635494 22515 raft_consensus.cc:1050] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:39.635962 22515 consensus_queue.cc:237] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.636229 18675 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.636525 16024 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.636685 22517 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.637090 17771 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.637316 18675 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.637637 21570 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.637955 22515 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.637982 21570 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.638190 17508 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.638579 15763 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.639283 22514 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.639616 22514 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.640537 22517 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.640846 16024 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.641516 17771 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.642822 22515 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.643986 15484 catalog_manager.cc:5484] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:39.644332 15763 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.645107 18675 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } attrs { replace: true } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.646731 17508 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.647161 18675 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.647433 15490 catalog_manager.cc:5484] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.648887 15891 consensus_queue.cc:237] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.650655 18675 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.651062 21570 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.652287 17771 raft_consensus.cc:1261] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer f7df976329f944319cef90e7116dfa96: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.652797 16024 consensus_queue.cc:237] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.653158 21570 consensus_queue.cc:1035] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.654489 18676 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.654505 17508 raft_consensus.cc:1261] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.654902 22459 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P f7df976329f944319cef90e7116dfa96 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.655020 20543 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.655339 20543 consensus_queue.cc:1035] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.655429 17771 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.656456 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 167efd92157a42ec84ea1cfb1de4a15c with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:39.657716 20543 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.658295 15484 catalog_manager.cc:5484] T 167efd92157a42ec84ea1cfb1de4a15c P 389fb867bde04f9980fe702dc1111079 reported cstate change: config changed from index 8 to 9, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "f7df976329f944319cef90e7116dfa96" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.659974 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 601b3ef7a0e34242a97210ff74c9e8b3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:39.659914 17508 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.661044 16004 tablet_service.cc:1514] Processing DeleteTablet for tablet 167efd92157a42ec84ea1cfb1de4a15c with delete_type TABLET_DATA_TOMBSTONED (TS 3be8cce319d343fca3df1cf166a55a74 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:47490
I20240502 20:46:39.661307 18676 raft_consensus.cc:2932] T 167efd92157a42ec84ea1cfb1de4a15c P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.663246 18676 raft_consensus.cc:2932] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.663877 15485 catalog_manager.cc:5484] T 601b3ef7a0e34242a97210ff74c9e8b3 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:39.667958 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet 601b3ef7a0e34242a97210ff74c9e8b3 with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:39.668179 22468 tablet_replica.cc:330] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:39.668315 22468 raft_consensus.cc:2229] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:39.668525 22468 raft_consensus.cc:2258] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:39.672246 22526 tablet_replica.cc:330] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74: stopping tablet replica
I20240502 20:46:39.672415 22526 raft_consensus.cc:2229] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:39.672554 22468 ts_tablet_manager.cc:1875] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:39.672645 22526 raft_consensus.cc:2258] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:39.673281 22526 ts_tablet_manager.cc:1875] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:39.674976 22468 ts_tablet_manager.cc:1888] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:39.675065 22468 log.cc:1196] T 601b3ef7a0e34242a97210ff74c9e8b3 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/601b3ef7a0e34242a97210ff74c9e8b3
I20240502 20:46:39.675702 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet 601b3ef7a0e34242a97210ff74c9e8b3 (table rebalance_test_table_2 [id=59ec32a9785e47e981544bac1206706f]) successfully deleted
I20240502 20:46:39.675793 22526 ts_tablet_manager.cc:1888] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:39.675868 22526 log.cc:1196] T 167efd92157a42ec84ea1cfb1de4a15c P 3be8cce319d343fca3df1cf166a55a74: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/167efd92157a42ec84ea1cfb1de4a15c
I20240502 20:46:39.676395 15476 catalog_manager.cc:4830] TS 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949): tablet 167efd92157a42ec84ea1cfb1de4a15c (table rebalance_test_table_1 [id=aa85e670b3404da1851c223baadfa453]) successfully deleted
I20240502 20:46:39.686553 22527 raft_consensus.cc:1050] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:39.686972 22527 consensus_queue.cc:237] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.688429 18676 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.688797 17771 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.688918 22527 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.689149 15891 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.689525 22527 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.689797 22339 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.691954 22527 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.692555 18676 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.694742 17771 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.695235 15891 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.695302 15486 catalog_manager.cc:5484] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f7df976329f944319cef90e7116dfa96" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 40885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:39.698870 15632 consensus_queue.cc:237] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.700083 18676 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.700632 22527 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.701380 17771 raft_consensus.cc:1261] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 8c5f48d02a284d0eb4b1fa3868ab669f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.701766 22532 consensus_queue.cc:1035] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.702224 22339 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.702664 18676 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.704743 15477 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8a46ac0be3ab49e185c300eeedb8cd39 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:39.705103 15490 catalog_manager.cc:5484] T 8a46ac0be3ab49e185c300eeedb8cd39 P 8c5f48d02a284d0eb4b1fa3868ab669f reported cstate change: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:39.705771 17771 raft_consensus.cc:2932] T 8a46ac0be3ab49e185c300eeedb8cd39 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER f7df976329f944319cef90e7116dfa96 (127.9.82.131) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8c5f48d02a284d0eb4b1fa3868ab669f" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 34245 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.708669 15874 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a46ac0be3ab49e185c300eeedb8cd39 with delete_type TABLET_DATA_TOMBSTONED (TS f7df976329f944319cef90e7116dfa96 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60580
I20240502 20:46:39.709100 22533 tablet_replica.cc:330] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96: stopping tablet replica
I20240502 20:46:39.709244 22533 raft_consensus.cc:2229] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:39.709431 22533 raft_consensus.cc:2258] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:39.710553 22533 ts_tablet_manager.cc:1875] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:39.712455 22533 ts_tablet_manager.cc:1888] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:39.712520 22533 log.cc:1196] T 8a46ac0be3ab49e185c300eeedb8cd39 P f7df976329f944319cef90e7116dfa96: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/8a46ac0be3ab49e185c300eeedb8cd39
I20240502 20:46:39.713022 15476 catalog_manager.cc:4830] TS f7df976329f944319cef90e7116dfa96 (127.9.82.131:40885): tablet 8a46ac0be3ab49e185c300eeedb8cd39 (table rebalance_test_table_7 [id=16184102d10f4caa9a06378cbc39f9fd]) successfully deleted
I20240502 20:46:39.772974 22525 raft_consensus.cc:1050] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 0eff851f85a5413c8847f817e3742379 to VOTER
I20240502 20:46:39.773378 22525 consensus_queue.cc:237] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.774672 18676 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.774900 15763 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.775040 17771 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:46:39.775050 20543 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.775341 22515 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.775535 20543 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:46:39.777796 22525 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.778314 17771 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.778322 15763 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.779933 18676 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.780815 15484 catalog_manager.cc:5484] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 7 to 8, 0eff851f85a5413c8847f817e3742379 (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0dfebe1fc59a48debca946314a5e3d0a" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 32937 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:39.784209 16024 consensus_queue.cc:237] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } }
I20240502 20:46:39.785274 17771 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.785439 18676 raft_consensus.cc:1261] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:46:39.785607 22515 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.785761 20543 consensus_queue.cc:1035] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:46:39.787240 22525 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.787626 18676 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.788074 17771 raft_consensus.cc:2932] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.788843 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:39.790956 15486 catalog_manager.cc:5484] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 389fb867bde04f9980fe702dc1111079 reported cstate change: config changed from index 8 to 9, VOTER 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "389fb867bde04f9980fe702dc1111079" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41687 } attrs { promote: false } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } }
I20240502 20:46:39.793274 15742 tablet_service.cc:1514] Processing DeleteTablet for tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 with delete_type TABLET_DATA_TOMBSTONED (TS 0dfebe1fc59a48debca946314a5e3d0a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:37976
I20240502 20:46:39.793532 22468 tablet_replica.cc:330] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a: stopping tablet replica
I20240502 20:46:39.793700 22468 raft_consensus.cc:2229] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:39.793900 22468 raft_consensus.cc:2258] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:39.794649 22468 ts_tablet_manager.cc:1875] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:39.796481 22468 ts_tablet_manager.cc:1888] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 20:46:39.796551 22468 log.cc:1196] T d1fcf1751e8f4b978ecbdb2535b7e1f1 P 0dfebe1fc59a48debca946314a5e3d0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/d1fcf1751e8f4b978ecbdb2535b7e1f1
I20240502 20:46:39.797118 15475 catalog_manager.cc:4830] TS 0dfebe1fc59a48debca946314a5e3d0a (127.9.82.130:32937): tablet d1fcf1751e8f4b978ecbdb2535b7e1f1 (table rebalance_test_table_9 [id=86b5bcd98d0e40abbcb41310ea36101c]) successfully deleted
I20240502 20:46:40.047505 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:40.049504 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:40.054905 17489 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:40.060849 18645 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:40.061028 15610 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:40.069996 16004 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:40.072842 17751 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:40.086046 17620 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:40.107554 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:40.142920 16024 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:40.144486 17378 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:46:40.144491 18676 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
W20240502 20:46:40.144698 15959 consensus_peers.cc:485] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 -> Peer 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134:35373): Couldn't send request to peer 376b7736472c4bf2836c4303abf8e6c3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2436658a9dd54854a8920f9242068ee7. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:40.144934 22525 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:40.145141 22515 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:46:40.146936 22525 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:40.147819 17378 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:40.149905 15485 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 9 to 10, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:40.150874 18676 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } } }
I20240502 20:46:40.541185 22632 ts_tablet_manager.cc:902] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: Initiating tablet copy from peer 3be8cce319d343fca3df1cf166a55a74 (127.9.82.132:33949)
I20240502 20:46:40.541700 22632 tablet_copy_client.cc:308] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:33949
I20240502 20:46:40.542268 16044 tablet_copy_service.cc:140] P 3be8cce319d343fca3df1cf166a55a74: Received BeginTabletCopySession request for tablet 2436658a9dd54854a8920f9242068ee7 from peer 376b7736472c4bf2836c4303abf8e6c3 ({username='slave'} at 127.9.82.134:35909)
I20240502 20:46:40.542382 16044 tablet_copy_service.cc:161] P 3be8cce319d343fca3df1cf166a55a74: Beginning new tablet copy session on tablet 2436658a9dd54854a8920f9242068ee7 from peer 376b7736472c4bf2836c4303abf8e6c3 at {username='slave'} at 127.9.82.134:35909: session id = 376b7736472c4bf2836c4303abf8e6c3-2436658a9dd54854a8920f9242068ee7
I20240502 20:46:40.543231 16044 tablet_copy_source_session.cc:205] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:40.544215 22632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2436658a9dd54854a8920f9242068ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:40.545989 22632 tablet_copy_client.cc:783] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:40.546129 22632 tablet_copy_client.cc:647] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:40.547279 22636 tablet_copy_client.cc:1002] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Injecting latency into file download: 1500
I20240502 20:46:42.047601 22632 tablet_copy_client.cc:523] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:42.049108 22632 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap starting.
I20240502 20:46:42.092074 22632 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:42.092411 22632 tablet_bootstrap.cc:492] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: Bootstrap complete.
I20240502 20:46:42.092612 22632 ts_tablet_manager.cc:1367] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: Time spent bootstrapping tablet: real 0.044s user 0.020s sys 0.000s
I20240502 20:46:42.093067 22632 raft_consensus.cc:348] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:42.093183 22632 raft_consensus.cc:729] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 376b7736472c4bf2836c4303abf8e6c3, State: Initialized, Role: LEARNER
I20240502 20:46:42.093271 22632 consensus_queue.cc:260] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 1.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: true } }
I20240502 20:46:42.093569 22632 ts_tablet_manager.cc:1398] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:42.094216 16044 tablet_copy_service.cc:342] P 3be8cce319d343fca3df1cf166a55a74: Request end of tablet copy session 376b7736472c4bf2836c4303abf8e6c3-2436658a9dd54854a8920f9242068ee7 received from {username='slave'} at 127.9.82.134:35909
I20240502 20:46:42.094307 16044 tablet_copy_service.cc:433] P 3be8cce319d343fca3df1cf166a55a74: ending tablet copy session 376b7736472c4bf2836c4303abf8e6c3-2436658a9dd54854a8920f9242068ee7 on tablet 2436658a9dd54854a8920f9242068ee7 with peer 376b7736472c4bf2836c4303abf8e6c3
I20240502 20:46:42.290488 17508 raft_consensus.cc:1203] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.9->[1.10-1.10] Dedup: 1.10->[]
I20240502 20:46:42.856770 22515 raft_consensus.cc:1050] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74: attempting to promote NON_VOTER 376b7736472c4bf2836c4303abf8e6c3 to VOTER
I20240502 20:46:42.857225 22515 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:42.858772 17508 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 LEARNER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:46:42.858850 17378 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:46:42.859073 18676 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:46:42.859409 22709 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:46:42.859622 22515 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:46:42.859871 22708 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:46:42.861642 22515 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:42.862085 17378 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:42.864171 18676 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:42.864357 17508 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:42.864570 15482 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 reported cstate change: config changed from index 10 to 11, 376b7736472c4bf2836c4303abf8e6c3 (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "049bb73c1cda4f3a95adddfc2a6ea66f" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 44363 } attrs { promote: false replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:46:42.869895 16025 consensus_queue.cc:237] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } }
I20240502 20:46:42.871246 17508 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:46:42.871584 18676 raft_consensus.cc:1261] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Refusing update from remote peer 3be8cce319d343fca3df1cf166a55a74: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:46:42.871716 22515 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:46:42.872081 22515 consensus_queue.cc:1035] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:46:42.873196 22708 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 3be8cce319d343fca3df1cf166a55a74 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:42.873559 17508 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 376b7736472c4bf2836c4303abf8e6c3 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:42.873992 18676 raft_consensus.cc:2932] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:42.874760 15476 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2436658a9dd54854a8920f9242068ee7 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:46:42.876641 15490 catalog_manager.cc:5484] T 2436658a9dd54854a8920f9242068ee7 P 0eff851f85a5413c8847f817e3742379 reported cstate change: config changed from index 11 to 12, VOTER 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "3be8cce319d343fca3df1cf166a55a74" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3be8cce319d343fca3df1cf166a55a74" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 33949 } } peers { permanent_uuid: "0eff851f85a5413c8847f817e3742379" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 37247 } attrs { promote: false } } peers { permanent_uuid: "376b7736472c4bf2836c4303abf8e6c3" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 35373 } attrs { promote: false } } }
I20240502 20:46:42.882426 17358 tablet_service.cc:1514] Processing DeleteTablet for tablet 2436658a9dd54854a8920f9242068ee7 with delete_type TABLET_DATA_TOMBSTONED (TS 049bb73c1cda4f3a95adddfc2a6ea66f not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:58106
I20240502 20:46:42.882851 22721 tablet_replica.cc:330] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: stopping tablet replica
I20240502 20:46:42.883143 22721 raft_consensus.cc:2229] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:46:42.883392 22721 raft_consensus.cc:2258] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:46:42.884418 22721 ts_tablet_manager.cc:1875] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:46:42.886132 22721 ts_tablet_manager.cc:1888] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.11
I20240502 20:46:42.886214 22721 log.cc:1196] T 2436658a9dd54854a8920f9242068ee7 P 049bb73c1cda4f3a95adddfc2a6ea66f: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/2436658a9dd54854a8920f9242068ee7
I20240502 20:46:42.886693 15477 catalog_manager.cc:4830] TS 049bb73c1cda4f3a95adddfc2a6ea66f (127.9.82.133:44363): tablet 2436658a9dd54854a8920f9242068ee7 (table rebalance_test_table_6 [id=bbeed518404f47819e5367b01747dd98]) successfully deleted
I20240502 20:46:43.125633 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.129678 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:43.132591 18645 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.138008 16004 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.144419 17489 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:43.157181 17620 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:43.163516 17751 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:43.178966 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:43.179798 15610 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.286789 18645 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.288697 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.292479 17489 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:43.295754 15610 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.296597 16004 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.308867 17751 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:43.311568 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:43.311890 17620 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:43.337599 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:43.587119 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.587414 17751 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:43.594288 16004 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.597613 17489 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:43.597873 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:43.598138 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:43.606889 18645 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.617956 17620 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:43.624363 15610 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.749878 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.753810 18645 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.755878 17620 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:43.760309 17489 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:43.761992 15610 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.762612 16004 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.788977 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:43.790391 17751 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:43.795895 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:43.937005 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:43.938340 17489 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:43.938730 17751 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:46:43.943284 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.943898 15610 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.944758 16004 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:43.954835 18645 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:43.955071 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:43.955737 17620 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:44.088624 17358 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:44.091298 18645 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:44.099767 16004 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:44.102615 15742 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:46:44.106014 15610 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 20:46:44.114391 17620 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:44.117808 17489 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:44.133890 15874 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:44.134002 17751 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
8fe765eb5fa44c818352e1248973b04e | 127.9.82.190:39049 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+--------------------+-------------------------
builtin_ntp_servers | 127.9.82.148:34563 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
049bb73c1cda4f3a95adddfc2a6ea66f | 127.9.82.133:44363 | HEALTHY | <none> | 0 | 0
0dfebe1fc59a48debca946314a5e3d0a | 127.9.82.130:32937 | HEALTHY | <none> | 4 | 0
0eff851f85a5413c8847f817e3742379 | 127.9.82.137:37247 | HEALTHY | <none> | 0 | 0
376b7736472c4bf2836c4303abf8e6c3 | 127.9.82.134:35373 | HEALTHY | <none> | 1 | 0
389fb867bde04f9980fe702dc1111079 | 127.9.82.136:41687 | HEALTHY | <none> | 2 | 0
3be8cce319d343fca3df1cf166a55a74 | 127.9.82.132:33949 | HEALTHY | <none> | 8 | 0
47eb2a910e8949308b382a74c55030b5 | 127.9.82.135:34733 | HEALTHY | <none> | 1 | 0
8c5f48d02a284d0eb4b1fa3868ab669f | 127.9.82.129:34245 | HEALTHY | <none> | 8 | 0
f7df976329f944319cef90e7116dfa96 | 127.9.82.131:40885 | HEALTHY | <none> | 6 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 9
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
---------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 9 server(s) checked
local_ip_for_outbound_sockets | 127.9.82.129 | experimental | 127.9.82.129:34245
local_ip_for_outbound_sockets | 127.9.82.130 | experimental | 127.9.82.130:32937
local_ip_for_outbound_sockets | 127.9.82.131 | experimental | 127.9.82.131:40885
local_ip_for_outbound_sockets | 127.9.82.132 | experimental | 127.9.82.132:33949
local_ip_for_outbound_sockets | 127.9.82.133 | experimental | 127.9.82.133:44363
local_ip_for_outbound_sockets | 127.9.82.134 | experimental | 127.9.82.134:35373
local_ip_for_outbound_sockets | 127.9.82.135 | experimental | 127.9.82.135:34733
local_ip_for_outbound_sockets | 127.9.82.136 | experimental | 127.9.82.136:41687
local_ip_for_outbound_sockets | 127.9.82.137 | experimental | 127.9.82.137:37247
never_fsync | true | unsafe,advanced | all 9 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 9 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 9 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 9 server(s) checked
server_dump_info_format | pb | hidden | all 9 server(s) checked
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.9.82.129:34245
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.9.82.130:32937
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.9.82.131:40885
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.9.82.132:33949
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.9.82.133:44363
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.9.82.134:35373
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.9.82.135:34733
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb | hidden | 127.9.82.136:41687
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb | hidden | 127.9.82.137:37247
tablet_copy_download_file_inject_latency_ms | 1500 | hidden | all 9 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+--------------------+-------------------------
builtin_ntp_servers | 127.9.82.148:34563 | all 9 server(s) checked
time_source | builtin | all 9 server(s) checked
Version Summary
Version | Servers
-----------------+--------------------------
1.18.0-SNAPSHOT | all 10 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
rebalance_test_table_0 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_5 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_6 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_7 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_8 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_9 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 10
First Quartile | 10
Median | 10
Third Quartile | 10
Maximum | 10
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 9
Tables | 10
Tablets | 30
Replicas | 90
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20240502 20:46:44.172224 9546 log_verifier.cc:126] Checking tablet 15214db73de54afba83b983bc2865948
I20240502 20:46:44.199370 9546 log_verifier.cc:177] Verified matching terms for 10 ops in tablet 15214db73de54afba83b983bc2865948
I20240502 20:46:44.199440 9546 log_verifier.cc:126] Checking tablet 15e0404ac2e44c36aa58c7b4c7705c11
I20240502 20:46:44.225397 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 15e0404ac2e44c36aa58c7b4c7705c11
I20240502 20:46:44.225463 9546 log_verifier.cc:126] Checking tablet 167efd92157a42ec84ea1cfb1de4a15c
I20240502 20:46:44.251389 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 167efd92157a42ec84ea1cfb1de4a15c
I20240502 20:46:44.251466 9546 log_verifier.cc:126] Checking tablet 1694de56984a4ca78f9dabaaca2677de
I20240502 20:46:44.277406 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 1694de56984a4ca78f9dabaaca2677de
I20240502 20:46:44.277529 9546 log_verifier.cc:126] Checking tablet 1abc3674e948410296824189a95ae253
I20240502 20:46:44.303462 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 1abc3674e948410296824189a95ae253
I20240502 20:46:44.303534 9546 log_verifier.cc:126] Checking tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc
I20240502 20:46:44.330570 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 1eb03dc9cdf04f7a9ef9b96da66ab7dc
I20240502 20:46:44.330638 9546 log_verifier.cc:126] Checking tablet 2436658a9dd54854a8920f9242068ee7
I20240502 20:46:44.357340 9546 log_verifier.cc:177] Verified matching terms for 12 ops in tablet 2436658a9dd54854a8920f9242068ee7
I20240502 20:46:44.357419 9546 log_verifier.cc:126] Checking tablet 281af65f89524fdeba2c97322a482009
I20240502 20:46:44.383462 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 281af65f89524fdeba2c97322a482009
I20240502 20:46:44.383534 9546 log_verifier.cc:126] Checking tablet 360284c2b0c34339bbaeb5a20ee193ac
I20240502 20:46:44.408878 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 360284c2b0c34339bbaeb5a20ee193ac
I20240502 20:46:44.408950 9546 log_verifier.cc:126] Checking tablet 3e16f4c2f41e41eeb40b67b147296581
I20240502 20:46:44.434918 9546 log_verifier.cc:177] Verified matching terms for 10 ops in tablet 3e16f4c2f41e41eeb40b67b147296581
I20240502 20:46:44.434988 9546 log_verifier.cc:126] Checking tablet 4c0e045d15114b8ea88ff5ef05f3c1e4
I20240502 20:46:44.459789 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 4c0e045d15114b8ea88ff5ef05f3c1e4
I20240502 20:46:44.459861 9546 log_verifier.cc:126] Checking tablet 601b3ef7a0e34242a97210ff74c9e8b3
I20240502 20:46:44.485203 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 601b3ef7a0e34242a97210ff74c9e8b3
I20240502 20:46:44.485278 9546 log_verifier.cc:126] Checking tablet 60c7001f651848b788926cde86a3c0f6
I20240502 20:46:44.511135 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 60c7001f651848b788926cde86a3c0f6
I20240502 20:46:44.511205 9546 log_verifier.cc:126] Checking tablet 68458e99b8b345428f95c3ef410545a3
I20240502 20:46:44.537194 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 68458e99b8b345428f95c3ef410545a3
I20240502 20:46:44.537259 9546 log_verifier.cc:126] Checking tablet 702e67697b514f7fb3975d56c253d918
I20240502 20:46:44.562372 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 702e67697b514f7fb3975d56c253d918
I20240502 20:46:44.562458 9546 log_verifier.cc:126] Checking tablet 7460cf8211d24a3d97085d1a36116a29
I20240502 20:46:44.588389 9546 log_verifier.cc:177] Verified matching terms for 10 ops in tablet 7460cf8211d24a3d97085d1a36116a29
I20240502 20:46:44.588479 9546 log_verifier.cc:126] Checking tablet 75f842e898b845f69b2617cc539b00db
I20240502 20:46:44.614981 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 75f842e898b845f69b2617cc539b00db
I20240502 20:46:44.615060 9546 log_verifier.cc:126] Checking tablet 86ff3421109a484f869fd29f63392186
I20240502 20:46:44.641268 9546 log_verifier.cc:177] Verified matching terms for 10 ops in tablet 86ff3421109a484f869fd29f63392186
I20240502 20:46:44.641353 9546 log_verifier.cc:126] Checking tablet 89f653589b534402b873b05f9c15bf24
I20240502 20:46:44.667610 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 89f653589b534402b873b05f9c15bf24
I20240502 20:46:44.667687 9546 log_verifier.cc:126] Checking tablet 8a392f6644c1465cada45ddddf4ee2c5
I20240502 20:46:44.695140 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 8a392f6644c1465cada45ddddf4ee2c5
I20240502 20:46:44.695281 9546 log_verifier.cc:126] Checking tablet 8a46ac0be3ab49e185c300eeedb8cd39
I20240502 20:46:44.721905 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 8a46ac0be3ab49e185c300eeedb8cd39
I20240502 20:46:44.721989 9546 log_verifier.cc:126] Checking tablet a6521649137d4bab9ecf18c8f81abaed
I20240502 20:46:44.748845 9546 log_verifier.cc:177] Verified matching terms for 10 ops in tablet a6521649137d4bab9ecf18c8f81abaed
I20240502 20:46:44.748930 9546 log_verifier.cc:126] Checking tablet a87847912eaa4602abf9bd9cf2c698fd
I20240502 20:46:44.775476 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet a87847912eaa4602abf9bd9cf2c698fd
I20240502 20:46:44.775547 9546 log_verifier.cc:126] Checking tablet b5981b9676cb4abab938aeaf7fe52c3d
I20240502 20:46:44.803213 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet b5981b9676cb4abab938aeaf7fe52c3d
I20240502 20:46:44.803288 9546 log_verifier.cc:126] Checking tablet ce9c2a00fa6b43938a7eb89a82bae6ce
I20240502 20:46:44.830986 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet ce9c2a00fa6b43938a7eb89a82bae6ce
I20240502 20:46:44.831086 9546 log_verifier.cc:126] Checking tablet d1fcf1751e8f4b978ecbdb2535b7e1f1
I20240502 20:46:44.857437 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet d1fcf1751e8f4b978ecbdb2535b7e1f1
I20240502 20:46:44.857514 9546 log_verifier.cc:126] Checking tablet d61acdada50a42ba96d4844e64dba6a7
I20240502 20:46:44.887423 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet d61acdada50a42ba96d4844e64dba6a7
I20240502 20:46:44.887495 9546 log_verifier.cc:126] Checking tablet ef8149e90bfc405db47acd6d6fe576ad
I20240502 20:46:44.918371 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet ef8149e90bfc405db47acd6d6fe576ad
I20240502 20:46:44.918442 9546 log_verifier.cc:126] Checking tablet effe8b25103e4fd6abafde8c7b425165
I20240502 20:46:44.949456 9546 log_verifier.cc:177] Verified matching terms for 9 ops in tablet effe8b25103e4fd6abafde8c7b425165
I20240502 20:46:44.949542 9546 log_verifier.cc:126] Checking tablet f015e46a8a27436dbd88b97dd1798cb0
I20240502 20:46:44.980583 9546 log_verifier.cc:177] Verified matching terms for 6 ops in tablet f015e46a8a27436dbd88b97dd1798cb0
I20240502 20:46:44.981060 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 15550
I20240502 20:46:44.990193 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 15681
I20240502 20:46:44.998981 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 15812
I20240502 20:46:45.007396 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 15943
I20240502 20:46:45.014880 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 17296
I20240502 20:46:45.021299 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 17427
I20240502 20:46:45.027709 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 17558
I20240502 20:46:45.034226 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 17689
I20240502 20:46:45.041036 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 18482
I20240502 20:46:45.047060 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 15459
2024-05-02T20:46:45Z chronyd exiting
[ OK ] TserverAddedDuringRebalancingTest.TserverStarts/1 (33136 ms)
[----------] 1 test from TserverAddedDuringRebalancingTest (33136 ms total)
[----------] 1 test from RebalancerAndSingleReplicaTablets
[ RUN ] RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove/5
I20240502 20:46:45.160398 9546 test_util.cc:268] Using random seed: -1283388984
I20240502 20:46:45.161206 9546 ts_itest-base.cc:112] Starting cluster with:
I20240502 20:46:45.161248 9546 ts_itest-base.cc:113] --------------
I20240502 20:46:45.161259 9546 ts_itest-base.cc:114] 4 tablet servers
I20240502 20:46:45.161269 9546 ts_itest-base.cc:115] 1 replicas per TS
I20240502 20:46:45.161279 9546 ts_itest-base.cc:116] --------------
2024-05-02T20:46:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T20:46:45Z Disabled control of system clock
I20240502 20:46:45.171157 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:41483
--webserver_interface=127.9.82.190
--webserver_port=0
--builtin_ntp_servers=127.9.82.148:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.82.190:41483
--raft_prepare_replacement_before_eviction=true
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false with env {}
W20240502 20:46:45.278259 22996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:45.278507 22996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:45.278579 22996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:45.281672 22996 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:45.281752 22996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 20:46:45.281791 22996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:45.281836 22996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 20:46:45.281877 22996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 20:46:45.285532 22996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.9.82.190:41483
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:41483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.9.82.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.22996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:45.286432 22996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:45.287528 22996 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:45.295225 23001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:45.295949 22996 server_base.cc:1034] running on GCE node
W20240502 20:46:45.296316 23002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:45.296813 23004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:45.297317 22996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:45.298204 22996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:45.299367 22996 hybrid_clock.cc:648] HybridClock initialized: now 1714682805299356 us; error 32 us; skew 500 ppm
I20240502 20:46:45.301342 22996 webserver.cc:460] Webserver started at http://127.9.82.190:43809/ using document root <none> and password file <none>
I20240502 20:46:45.301882 22996 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:45.301945 22996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:45.302126 22996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:45.303781 22996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "15c036958b4c4d7c8742d504e4fd77e9"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.304261 22996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "15c036958b4c4d7c8742d504e4fd77e9"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.307885 22996 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20240502 20:46:45.310060 23010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.311025 22996 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:45.311153 22996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
uuid: "15c036958b4c4d7c8742d504e4fd77e9"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.311237 22996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:45.323910 22996 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:45.324468 22996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:45.324630 22996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:45.331347 22996 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.190:41483
I20240502 20:46:45.331357 23062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.190:41483 every 8 connection(s)
I20240502 20:46:45.332310 22996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 20:46:45.334774 23063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:45.336838 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 22996
I20240502 20:46:45.337018 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 20:46:45.340058 23063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9: Bootstrap starting.
I20240502 20:46:45.342352 23063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:45.343189 23063 log.cc:824] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:45.344880 23063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9: No bootstrap required, opened a new log
I20240502 20:46:45.347360 23063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15c036958b4c4d7c8742d504e4fd77e9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 41483 } }
I20240502 20:46:45.347530 23063 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:45.347568 23063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15c036958b4c4d7c8742d504e4fd77e9, State: Initialized, Role: FOLLOWER
I20240502 20:46:45.347990 23063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15c036958b4c4d7c8742d504e4fd77e9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 41483 } }
I20240502 20:46:45.348110 23063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:45.348171 23063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:45.348277 23063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:45.348996 23063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15c036958b4c4d7c8742d504e4fd77e9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 41483 } }
I20240502 20:46:45.349309 23063 leader_election.cc:302] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15c036958b4c4d7c8742d504e4fd77e9; no voters:
I20240502 20:46:45.349566 23063 leader_election.cc:288] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:45.349972 23068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:45.350181 23068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [term 1 LEADER]: Becoming Leader. State: Replica: 15c036958b4c4d7c8742d504e4fd77e9, State: Running, Role: LEADER
I20240502 20:46:45.350462 23068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15c036958b4c4d7c8742d504e4fd77e9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 41483 } }
I20240502 20:46:45.350606 23063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 20:46:45.351883 23070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15c036958b4c4d7c8742d504e4fd77e9. Latest consensus state: current_term: 1 leader_uuid: "15c036958b4c4d7c8742d504e4fd77e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15c036958b4c4d7c8742d504e4fd77e9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 41483 } } }
I20240502 20:46:45.352016 23070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [sys.catalog]: This master's current role is: LEADER
I20240502 20:46:45.352025 23069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15c036958b4c4d7c8742d504e4fd77e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15c036958b4c4d7c8742d504e4fd77e9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 41483 } } }
I20240502 20:46:45.352378 23069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9 [sys.catalog]: This master's current role is: LEADER
W20240502 20:46:45.354951 23083 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20240502 20:46:45.355020 23083 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20240502 20:46:45.355104 23078 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 20:46:45.355926 23078 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 20:46:45.361184 23078 catalog_manager.cc:1347] Generated new cluster ID: 5e2e22b74fa240f7aa3ae25abae7df34
I20240502 20:46:45.361250 23078 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 20:46:45.369964 23078 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 20:46:45.370880 23078 catalog_manager.cc:1504] Loading token signing keys...
I20240502 20:46:45.383124 23078 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 15c036958b4c4d7c8742d504e4fd77e9: Generated new TSK 0
I20240502 20:46:45.383867 23078 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 20:46:45.387171 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.129:0
--local_ip_for_outbound_sockets=127.9.82.129
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:41483
--builtin_ntp_servers=127.9.82.148:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:46:45.517912 23087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:45.518141 23087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:45.518185 23087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:45.521292 23087 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:45.521368 23087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:45.521452 23087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.129
I20240502 20:46:45.525156 23087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:41483
--never_fsync=true
--heap_profile_path=/tmp/kudu.23087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.129
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:45.526083 23087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:45.527308 23087 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:45.535547 23092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:45.535967 23093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:45.536644 23095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:45.537353 23087 server_base.cc:1034] running on GCE node
I20240502 20:46:45.537747 23087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:45.538301 23087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:45.539474 23087 hybrid_clock.cc:648] HybridClock initialized: now 1714682805539464 us; error 30 us; skew 500 ppm
I20240502 20:46:45.541487 23087 webserver.cc:460] Webserver started at http://127.9.82.129:44085/ using document root <none> and password file <none>
I20240502 20:46:45.542035 23087 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:45.542093 23087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:45.542294 23087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:45.543967 23087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "9c50595213a94b27a8bb4686bf4426af"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.544459 23087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "9c50595213a94b27a8bb4686bf4426af"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.547675 23087 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:46:45.549820 23101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.550786 23087 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240502 20:46:45.550891 23087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "9c50595213a94b27a8bb4686bf4426af"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.550980 23087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:45.581248 23087 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:45.581907 23087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:45.582078 23087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:45.582623 23087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:45.583523 23087 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:45.583572 23087 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.583639 23087 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:45.583674 23087 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.592384 23087 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.129:37235
I20240502 20:46:45.592414 23214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.129:37235 every 8 connection(s)
I20240502 20:46:45.593358 23087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 20:46:45.595418 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 23087
I20240502 20:46:45.595537 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 20:46:45.597882 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.130:0
--local_ip_for_outbound_sockets=127.9.82.130
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:41483
--builtin_ntp_servers=127.9.82.148:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:46:45.602916 23215 heartbeater.cc:347] Connected to a master server at 127.9.82.190:41483
I20240502 20:46:45.603227 23215 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:45.604069 23215 heartbeater.cc:511] Master 127.9.82.190:41483 requested a full tablet report, sending...
I20240502 20:46:45.605751 23027 ts_manager.cc:194] Registered new tserver with Master: 9c50595213a94b27a8bb4686bf4426af (127.9.82.129:37235)
I20240502 20:46:45.606940 23027 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.129:45207
W20240502 20:46:45.710084 23218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:45.710311 23218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:45.710371 23218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:45.713642 23218 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:45.713711 23218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:45.713795 23218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.130
I20240502 20:46:45.717545 23218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:41483
--never_fsync=true
--heap_profile_path=/tmp/kudu.23218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.130
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:45.718472 23218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:45.719599 23218 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:45.728166 23224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:45.728529 23226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:45.728994 23223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:45.729836 23218 server_base.cc:1034] running on GCE node
I20240502 20:46:45.730250 23218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:45.730826 23218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:45.731976 23218 hybrid_clock.cc:648] HybridClock initialized: now 1714682805731963 us; error 32 us; skew 500 ppm
I20240502 20:46:45.733981 23218 webserver.cc:460] Webserver started at http://127.9.82.130:41343/ using document root <none> and password file <none>
I20240502 20:46:45.734539 23218 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:45.734602 23218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:45.734784 23218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:45.736526 23218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "6beb9b250c3f4b4993459b64027fc6d0"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.737010 23218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "6beb9b250c3f4b4993459b64027fc6d0"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.740499 23218 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:46:45.742718 23232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.743710 23218 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:45.743861 23218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "6beb9b250c3f4b4993459b64027fc6d0"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.743952 23218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:45.764719 23218 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:45.765341 23218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:45.765508 23218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:45.766036 23218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:45.766907 23218 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:45.766959 23218 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.767021 23218 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:45.767050 23218 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.775323 23218 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.130:41513
I20240502 20:46:45.775363 23345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.130:41513 every 8 connection(s)
I20240502 20:46:45.776314 23218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 20:46:45.784680 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 23218
I20240502 20:46:45.784821 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 20:46:45.784832 23346 heartbeater.cc:347] Connected to a master server at 127.9.82.190:41483
I20240502 20:46:45.785051 23346 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:45.785574 23346 heartbeater.cc:511] Master 127.9.82.190:41483 requested a full tablet report, sending...
I20240502 20:46:45.786551 23027 ts_manager.cc:194] Registered new tserver with Master: 6beb9b250c3f4b4993459b64027fc6d0 (127.9.82.130:41513)
I20240502 20:46:45.787091 23027 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.130:44185
I20240502 20:46:45.787904 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.131:0
--local_ip_for_outbound_sockets=127.9.82.131
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:41483
--builtin_ntp_servers=127.9.82.148:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:46:45.896725 23349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:45.896927 23349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:45.896986 23349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:45.899947 23349 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:45.900036 23349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:45.900121 23349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.131
I20240502 20:46:45.903661 23349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:41483
--never_fsync=true
--heap_profile_path=/tmp/kudu.23349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.131
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:45.904525 23349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:45.905649 23349 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:45.913785 23355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:45.914208 23357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:45.914726 23354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:45.915491 23349 server_base.cc:1034] running on GCE node
I20240502 20:46:45.915938 23349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:45.916499 23349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:45.917672 23349 hybrid_clock.cc:648] HybridClock initialized: now 1714682805917650 us; error 36 us; skew 500 ppm
I20240502 20:46:45.919631 23349 webserver.cc:460] Webserver started at http://127.9.82.131:41947/ using document root <none> and password file <none>
I20240502 20:46:45.920224 23349 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:45.920284 23349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:45.920454 23349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:45.922183 23349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "8aaa4284ec1148d4b925fe625771cdfd"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.923391 23349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "8aaa4284ec1148d4b925fe625771cdfd"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.926982 23349 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:46:45.929198 23363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.930207 23349 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:45.930320 23349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "8aaa4284ec1148d4b925fe625771cdfd"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:45.930405 23349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:45.950815 23349 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:45.951428 23349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:45.951597 23349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:45.952206 23349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:45.953089 23349 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:45.953141 23349 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.953197 23349 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:45.953230 23349 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:45.961905 23349 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.131:40545
I20240502 20:46:45.961936 23476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.131:40545 every 8 connection(s)
I20240502 20:46:45.962877 23349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 20:46:45.964303 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 23349
I20240502 20:46:45.964430 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 20:46:45.966722 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.132:0
--local_ip_for_outbound_sockets=127.9.82.132
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:41483
--builtin_ntp_servers=127.9.82.148:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:46:45.972365 23477 heartbeater.cc:347] Connected to a master server at 127.9.82.190:41483
I20240502 20:46:45.972590 23477 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:45.973121 23477 heartbeater.cc:511] Master 127.9.82.190:41483 requested a full tablet report, sending...
I20240502 20:46:45.974138 23027 ts_manager.cc:194] Registered new tserver with Master: 8aaa4284ec1148d4b925fe625771cdfd (127.9.82.131:40545)
I20240502 20:46:45.974687 23027 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.131:36525
W20240502 20:46:46.081157 23480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:46.081409 23480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:46.081478 23480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:46.084623 23480 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:46.084710 23480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:46.084805 23480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.132
I20240502 20:46:46.088488 23480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:41483
--never_fsync=true
--heap_profile_path=/tmp/kudu.23480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.132
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:46.089444 23480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:46.090615 23480 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:46.099562 23485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:46.099939 23488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:46.100666 23486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:46.101321 23480 server_base.cc:1034] running on GCE node
I20240502 20:46:46.101766 23480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:46.102478 23480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:46.103654 23480 hybrid_clock.cc:648] HybridClock initialized: now 1714682806103639 us; error 35 us; skew 500 ppm
I20240502 20:46:46.105783 23480 webserver.cc:460] Webserver started at http://127.9.82.132:44167/ using document root <none> and password file <none>
I20240502 20:46:46.106357 23480 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:46.106427 23480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:46.106606 23480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:46.108366 23480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "d2b2106cae3c49c6b840295005224f96"
format_stamp: "Formatted at 2024-05-02 20:46:46 on dist-test-slave-2pss"
I20240502 20:46:46.108841 23480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "d2b2106cae3c49c6b840295005224f96"
format_stamp: "Formatted at 2024-05-02 20:46:46 on dist-test-slave-2pss"
I20240502 20:46:46.112128 23480 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20240502 20:46:46.114234 23494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:46.115231 23480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:46.115330 23480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "d2b2106cae3c49c6b840295005224f96"
format_stamp: "Formatted at 2024-05-02 20:46:46 on dist-test-slave-2pss"
I20240502 20:46:46.115410 23480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:46.135145 23480 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:46.135883 23480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:46.136057 23480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:46.136634 23480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:46.137717 23480 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:46.137775 23480 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:46.137838 23480 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:46.137866 23480 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:46.146644 23480 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.132:44783
I20240502 20:46:46.146678 23607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.132:44783 every 8 connection(s)
I20240502 20:46:46.147698 23480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 20:46:46.155109 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 23480
I20240502 20:46:46.155268 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 20:46:46.158125 23608 heartbeater.cc:347] Connected to a master server at 127.9.82.190:41483
I20240502 20:46:46.158376 23608 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:46.158941 23608 heartbeater.cc:511] Master 127.9.82.190:41483 requested a full tablet report, sending...
I20240502 20:46:46.160044 23027 ts_manager.cc:194] Registered new tserver with Master: d2b2106cae3c49c6b840295005224f96 (127.9.82.132:44783)
I20240502 20:46:46.160604 23027 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.132:50577
I20240502 20:46:46.170047 9546 external_mini_cluster.cc:930] 4 TS(s) registered with all masters
I20240502 20:46:46.179550 23027 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59610:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20240502 20:46:46.195469 23542 tablet_service.cc:1467] Processing CreateTablet for tablet 2d33b26018424aa8ab87cd3fdc05a013 (DEFAULT_TABLE table=TestTable [id=a2e9b8cc0f8d4a6f9f5dfea8afa04e2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:46.196375 23542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d33b26018424aa8ab87cd3fdc05a013. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:46.201511 23621 tablet_bootstrap.cc:492] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Bootstrap starting.
I20240502 20:46:46.203351 23621 tablet_bootstrap.cc:654] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:46.204087 23621 log.cc:824] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:46.205725 23621 tablet_bootstrap.cc:492] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: No bootstrap required, opened a new log
I20240502 20:46:46.205911 23621 ts_tablet_manager.cc:1367] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 20:46:46.208760 23621 raft_consensus.cc:348] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } }
I20240502 20:46:46.208932 23621 raft_consensus.cc:374] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:46.208972 23621 raft_consensus.cc:729] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2b2106cae3c49c6b840295005224f96, State: Initialized, Role: FOLLOWER
I20240502 20:46:46.209319 23621 consensus_queue.cc:260] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } }
I20240502 20:46:46.209424 23621 raft_consensus.cc:388] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:46.209468 23621 raft_consensus.cc:482] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:46.209544 23621 raft_consensus.cc:3037] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:46.210264 23621 raft_consensus.cc:504] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } }
I20240502 20:46:46.210541 23621 leader_election.cc:302] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2b2106cae3c49c6b840295005224f96; no voters:
I20240502 20:46:46.210788 23621 leader_election.cc:288] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:46.210889 23623 raft_consensus.cc:2781] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:46.211099 23623 raft_consensus.cc:686] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 1 LEADER]: Becoming Leader. State: Replica: d2b2106cae3c49c6b840295005224f96, State: Running, Role: LEADER
I20240502 20:46:46.211436 23608 heartbeater.cc:503] Master 127.9.82.190:41483 was elected leader, sending a full tablet report...
I20240502 20:46:46.211628 23621 ts_tablet_manager.cc:1398] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20240502 20:46:46.211896 23623 consensus_queue.cc:237] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } }
I20240502 20:46:46.215312 23027 catalog_manager.cc:5484] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2b2106cae3c49c6b840295005224f96 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "d2b2106cae3c49c6b840295005224f96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:46.222007 9546 external_mini_cluster.cc:930] 4 TS(s) registered with all masters
I20240502 20:46:46.223363 9546 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 9c50595213a94b27a8bb4686bf4426af to finish bootstrapping
I20240502 20:46:46.229190 9546 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 6beb9b250c3f4b4993459b64027fc6d0 to finish bootstrapping
I20240502 20:46:46.235337 9546 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 8aaa4284ec1148d4b925fe625771cdfd to finish bootstrapping
I20240502 20:46:46.241093 9546 ts_itest-base.cc:233] Waiting for 1 tablets on tserver d2b2106cae3c49c6b840295005224f96 to finish bootstrapping
I20240502 20:46:46.246124 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 23349
I20240502 20:46:46.252779 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 23480
I20240502 20:46:46.609803 23215 heartbeater.cc:503] Master 127.9.82.190:41483 was elected leader, sending a full tablet report...
I20240502 20:46:46.789040 23346 heartbeater.cc:503] Master 127.9.82.190:41483 was elected leader, sending a full tablet report...
I20240502 20:46:50.009856 23025 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59610:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:50.023454 23280 tablet_service.cc:1467] Processing CreateTablet for tablet 40b55bde55a642f0a23f99b492fa4b03 (DEFAULT_TABLE table=rebalance_test_table_0 [id=596c7ede5aa8465d9a23b9bcc3acb897]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.023386 23149 tablet_service.cc:1467] Processing CreateTablet for tablet 0fcb5f4188f7493e9d3e7b3861d648f6 (DEFAULT_TABLE table=rebalance_test_table_0 [id=596c7ede5aa8465d9a23b9bcc3acb897]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.023392 23148 tablet_service.cc:1467] Processing CreateTablet for tablet 62017599d332463a9b9de56744ecdaa6 (DEFAULT_TABLE table=rebalance_test_table_0 [id=596c7ede5aa8465d9a23b9bcc3acb897]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.024417 23280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40b55bde55a642f0a23f99b492fa4b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.024431 23148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62017599d332463a9b9de56744ecdaa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.024767 23149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fcb5f4188f7493e9d3e7b3861d648f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.029404 23640 tablet_bootstrap.cc:492] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0: Bootstrap starting.
I20240502 20:46:50.030037 23641 tablet_bootstrap.cc:492] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af: Bootstrap starting.
I20240502 20:46:50.031641 23640 tablet_bootstrap.cc:654] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.032229 23641 tablet_bootstrap.cc:654] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.032537 23640 log.cc:824] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:50.032996 23641 log.cc:824] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:50.034265 23640 tablet_bootstrap.cc:492] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0: No bootstrap required, opened a new log
I20240502 20:46:50.034452 23640 ts_tablet_manager.cc:1367] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 20:46:50.034610 23641 tablet_bootstrap.cc:492] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af: No bootstrap required, opened a new log
I20240502 20:46:50.034775 23641 ts_tablet_manager.cc:1367] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 20:46:50.038376 23640 raft_consensus.cc:348] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.038375 23641 raft_consensus.cc:348] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.038595 23640 raft_consensus.cc:374] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.038597 23641 raft_consensus.cc:374] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.038659 23640 raft_consensus.cc:729] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.038659 23641 raft_consensus.cc:729] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.039134 23641 consensus_queue.cc:260] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.039134 23640 consensus_queue.cc:260] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.039278 23640 raft_consensus.cc:388] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.039278 23641 raft_consensus.cc:388] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.039347 23641 raft_consensus.cc:482] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.039347 23640 raft_consensus.cc:482] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.039459 23640 raft_consensus.cc:3037] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.039459 23641 raft_consensus.cc:3037] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.040501 23641 raft_consensus.cc:504] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.040501 23640 raft_consensus.cc:504] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.040884 23641 leader_election.cc:302] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c50595213a94b27a8bb4686bf4426af; no voters:
I20240502 20:46:50.040884 23640 leader_election.cc:302] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6beb9b250c3f4b4993459b64027fc6d0; no voters:
I20240502 20:46:50.041222 23640 leader_election.cc:288] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.041222 23641 leader_election.cc:288] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.041599 23646 raft_consensus.cc:2781] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.041841 23646 raft_consensus.cc:686] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Running, Role: LEADER
I20240502 20:46:50.042109 23641 ts_tablet_manager.cc:1398] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20240502 20:46:50.042109 23640 ts_tablet_manager.cc:1398] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20240502 20:46:50.042223 23646 consensus_queue.cc:237] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.042523 23645 raft_consensus.cc:2781] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.042742 23645 raft_consensus.cc:686] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [term 1 LEADER]: Becoming Leader. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Running, Role: LEADER
I20240502 20:46:50.042826 23641 tablet_bootstrap.cc:492] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af: Bootstrap starting.
I20240502 20:46:50.043056 23645 consensus_queue.cc:237] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.043902 23641 tablet_bootstrap.cc:654] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.045449 23025 catalog_manager.cc:5484] T 40b55bde55a642f0a23f99b492fa4b03 P 6beb9b250c3f4b4993459b64027fc6d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beb9b250c3f4b4993459b64027fc6d0 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "6beb9b250c3f4b4993459b64027fc6d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.045965 23027 catalog_manager.cc:5484] T 0fcb5f4188f7493e9d3e7b3861d648f6 P 9c50595213a94b27a8bb4686bf4426af reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c50595213a94b27a8bb4686bf4426af (127.9.82.129). New cstate: current_term: 1 leader_uuid: "9c50595213a94b27a8bb4686bf4426af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.046423 23641 tablet_bootstrap.cc:492] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af: No bootstrap required, opened a new log
I20240502 20:46:50.046514 23641 ts_tablet_manager.cc:1367] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:50.047103 23641 raft_consensus.cc:348] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.047202 23641 raft_consensus.cc:374] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.047269 23641 raft_consensus.cc:729] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.047467 23641 consensus_queue.cc:260] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.047565 23641 raft_consensus.cc:388] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.047628 23641 raft_consensus.cc:482] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.047742 23641 raft_consensus.cc:3037] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.048915 23641 raft_consensus.cc:504] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.049057 23641 leader_election.cc:302] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c50595213a94b27a8bb4686bf4426af; no voters:
I20240502 20:46:50.049156 23641 leader_election.cc:288] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.049206 23645 raft_consensus.cc:2781] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.049316 23645 raft_consensus.cc:686] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [term 1 LEADER]: Becoming Leader. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Running, Role: LEADER
I20240502 20:46:50.049437 23645 consensus_queue.cc:237] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.049713 23641 ts_tablet_manager.cc:1398] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20240502 20:46:50.051415 23026 catalog_manager.cc:5484] T 62017599d332463a9b9de56744ecdaa6 P 9c50595213a94b27a8bb4686bf4426af reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c50595213a94b27a8bb4686bf4426af (127.9.82.129). New cstate: current_term: 1 leader_uuid: "9c50595213a94b27a8bb4686bf4426af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.233310 23026 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59610:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:50.239037 23279 tablet_service.cc:1467] Processing CreateTablet for tablet aaa1be2cfe4c4c1d816d9891798dec98 (DEFAULT_TABLE table=rebalance_test_table_1 [id=8faa4696d2ff4d4587520cd85e5dbdee]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.239037 23280 tablet_service.cc:1467] Processing CreateTablet for tablet 4a53208ad30a4b25b577226e6dc56492 (DEFAULT_TABLE table=rebalance_test_table_1 [id=8faa4696d2ff4d4587520cd85e5dbdee]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.239279 23148 tablet_service.cc:1467] Processing CreateTablet for tablet 54913c1d772d4383b3edfaada767a6cd (DEFAULT_TABLE table=rebalance_test_table_1 [id=8faa4696d2ff4d4587520cd85e5dbdee]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.239460 23279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aaa1be2cfe4c4c1d816d9891798dec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.239537 23148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54913c1d772d4383b3edfaada767a6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.239645 23280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a53208ad30a4b25b577226e6dc56492. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.241317 23640 tablet_bootstrap.cc:492] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0: Bootstrap starting.
I20240502 20:46:50.241681 23641 tablet_bootstrap.cc:492] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af: Bootstrap starting.
I20240502 20:46:50.242281 23640 tablet_bootstrap.cc:654] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.242518 23641 tablet_bootstrap.cc:654] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.243367 23640 tablet_bootstrap.cc:492] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0: No bootstrap required, opened a new log
I20240502 20:46:50.243463 23640 ts_tablet_manager.cc:1367] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:50.243803 23641 tablet_bootstrap.cc:492] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af: No bootstrap required, opened a new log
I20240502 20:46:50.243892 23641 ts_tablet_manager.cc:1367] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:50.244114 23640 raft_consensus.cc:348] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.244210 23640 raft_consensus.cc:374] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.244244 23640 raft_consensus.cc:729] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.244381 23640 consensus_queue.cc:260] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.244375 23641 raft_consensus.cc:348] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.244477 23640 raft_consensus.cc:388] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.244479 23641 raft_consensus.cc:374] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.244513 23641 raft_consensus.cc:729] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.244514 23640 raft_consensus.cc:482] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.244554 23640 raft_consensus.cc:3037] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.244616 23641 consensus_queue.cc:260] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.244685 23641 raft_consensus.cc:388] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.244714 23641 raft_consensus.cc:482] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.244740 23641 raft_consensus.cc:3037] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.245173 23640 raft_consensus.cc:504] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.245273 23640 leader_election.cc:302] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6beb9b250c3f4b4993459b64027fc6d0; no voters:
I20240502 20:46:50.245344 23640 leader_election.cc:288] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.245353 23641 raft_consensus.cc:504] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.245425 23646 raft_consensus.cc:2781] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.245474 23641 leader_election.cc:302] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c50595213a94b27a8bb4686bf4426af; no voters:
I20240502 20:46:50.245512 23646 raft_consensus.cc:686] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Running, Role: LEADER
I20240502 20:46:50.245569 23641 leader_election.cc:288] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.245633 23647 raft_consensus.cc:2781] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.245635 23646 consensus_queue.cc:237] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.245715 23647 raft_consensus.cc:686] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [term 1 LEADER]: Becoming Leader. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Running, Role: LEADER
I20240502 20:46:50.245827 23647 consensus_queue.cc:237] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.245975 23641 ts_tablet_manager.cc:1398] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:50.246500 23640 ts_tablet_manager.cc:1398] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 20:46:50.246716 23640 tablet_bootstrap.cc:492] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0: Bootstrap starting.
I20240502 20:46:50.247265 23026 catalog_manager.cc:5484] T aaa1be2cfe4c4c1d816d9891798dec98 P 6beb9b250c3f4b4993459b64027fc6d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beb9b250c3f4b4993459b64027fc6d0 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "6beb9b250c3f4b4993459b64027fc6d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.247350 23027 catalog_manager.cc:5484] T 54913c1d772d4383b3edfaada767a6cd P 9c50595213a94b27a8bb4686bf4426af reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c50595213a94b27a8bb4686bf4426af (127.9.82.129). New cstate: current_term: 1 leader_uuid: "9c50595213a94b27a8bb4686bf4426af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.247754 23640 tablet_bootstrap.cc:654] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.248929 23640 tablet_bootstrap.cc:492] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0: No bootstrap required, opened a new log
I20240502 20:46:50.249001 23640 ts_tablet_manager.cc:1367] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:50.249416 23640 raft_consensus.cc:348] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.249506 23640 raft_consensus.cc:374] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.249550 23640 raft_consensus.cc:729] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.249670 23640 consensus_queue.cc:260] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.249747 23640 raft_consensus.cc:388] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.249778 23640 raft_consensus.cc:482] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.249819 23640 raft_consensus.cc:3037] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.250635 23640 raft_consensus.cc:504] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.250756 23640 leader_election.cc:302] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6beb9b250c3f4b4993459b64027fc6d0; no voters:
I20240502 20:46:50.250841 23640 leader_election.cc:288] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.251124 23648 raft_consensus.cc:2781] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.251212 23648 raft_consensus.cc:686] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Running, Role: LEADER
I20240502 20:46:50.251322 23648 consensus_queue.cc:237] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.251359 23640 ts_tablet_manager.cc:1398] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:50.253034 23026 catalog_manager.cc:5484] T 4a53208ad30a4b25b577226e6dc56492 P 6beb9b250c3f4b4993459b64027fc6d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beb9b250c3f4b4993459b64027fc6d0 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "6beb9b250c3f4b4993459b64027fc6d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.430752 23026 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59610:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:50.436452 23148 tablet_service.cc:1467] Processing CreateTablet for tablet 9b75f184e5194a4591a6fbcfad137171 (DEFAULT_TABLE table=rebalance_test_table_2 [id=eb05dd44126344338e3256fb3e74b510]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.436471 23280 tablet_service.cc:1467] Processing CreateTablet for tablet 848fe657d16243ec815ca55c2d5c626d (DEFAULT_TABLE table=rebalance_test_table_2 [id=eb05dd44126344338e3256fb3e74b510]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.436786 23148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b75f184e5194a4591a6fbcfad137171. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.436786 23280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 848fe657d16243ec815ca55c2d5c626d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.438894 23640 tablet_bootstrap.cc:492] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0: Bootstrap starting.
I20240502 20:46:50.438895 23641 tablet_bootstrap.cc:492] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af: Bootstrap starting.
I20240502 20:46:50.439442 23148 tablet_service.cc:1467] Processing CreateTablet for tablet d8b19640eec846c6b48595ea22185756 (DEFAULT_TABLE table=rebalance_test_table_2 [id=eb05dd44126344338e3256fb3e74b510]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.439677 23148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b19640eec846c6b48595ea22185756. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.439872 23641 tablet_bootstrap.cc:654] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.439872 23640 tablet_bootstrap.cc:654] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.441092 23641 tablet_bootstrap.cc:492] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af: No bootstrap required, opened a new log
I20240502 20:46:50.441097 23640 tablet_bootstrap.cc:492] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0: No bootstrap required, opened a new log
I20240502 20:46:50.441180 23641 ts_tablet_manager.cc:1367] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 20:46:50.441180 23640 ts_tablet_manager.cc:1367] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:50.441622 23640 raft_consensus.cc:348] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.441623 23641 raft_consensus.cc:348] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.441730 23640 raft_consensus.cc:374] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.441730 23641 raft_consensus.cc:374] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.441764 23640 raft_consensus.cc:729] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.441764 23641 raft_consensus.cc:729] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.441893 23641 consensus_queue.cc:260] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.441893 23640 consensus_queue.cc:260] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.441977 23641 raft_consensus.cc:388] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.441977 23640 raft_consensus.cc:388] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.442018 23640 raft_consensus.cc:482] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.442018 23641 raft_consensus.cc:482] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.442062 23641 raft_consensus.cc:3037] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.442062 23640 raft_consensus.cc:3037] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.442873 23640 raft_consensus.cc:504] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.442875 23641 raft_consensus.cc:504] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.442991 23640 leader_election.cc:302] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6beb9b250c3f4b4993459b64027fc6d0; no voters:
I20240502 20:46:50.442991 23641 leader_election.cc:302] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c50595213a94b27a8bb4686bf4426af; no voters:
I20240502 20:46:50.443084 23641 leader_election.cc:288] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.443089 23640 leader_election.cc:288] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.443156 23648 raft_consensus.cc:2781] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.443176 23649 raft_consensus.cc:2781] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.443264 23649 raft_consensus.cc:686] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [term 1 LEADER]: Becoming Leader. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Running, Role: LEADER
I20240502 20:46:50.443269 23648 raft_consensus.cc:686] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Running, Role: LEADER
I20240502 20:46:50.443378 23649 consensus_queue.cc:237] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.443377 23648 consensus_queue.cc:237] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.443430 23640 ts_tablet_manager.cc:1398] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 20:46:50.443445 23641 ts_tablet_manager.cc:1398] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:50.443579 23641 tablet_bootstrap.cc:492] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af: Bootstrap starting.
I20240502 20:46:50.444500 23641 tablet_bootstrap.cc:654] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.445106 23026 catalog_manager.cc:5484] T 848fe657d16243ec815ca55c2d5c626d P 6beb9b250c3f4b4993459b64027fc6d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beb9b250c3f4b4993459b64027fc6d0 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "6beb9b250c3f4b4993459b64027fc6d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.445514 23641 tablet_bootstrap.cc:492] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af: No bootstrap required, opened a new log
I20240502 20:46:50.445608 23641 ts_tablet_manager.cc:1367] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:50.446030 23641 raft_consensus.cc:348] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.446182 23641 raft_consensus.cc:374] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.446228 23641 raft_consensus.cc:729] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.446388 23641 consensus_queue.cc:260] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.446470 23641 raft_consensus.cc:388] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.446542 23641 raft_consensus.cc:482] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.446604 23641 raft_consensus.cc:3037] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.447351 23641 raft_consensus.cc:504] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.447461 23641 leader_election.cc:302] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c50595213a94b27a8bb4686bf4426af; no voters:
I20240502 20:46:50.447427 23027 catalog_manager.cc:5484] T 9b75f184e5194a4591a6fbcfad137171 P 9c50595213a94b27a8bb4686bf4426af reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c50595213a94b27a8bb4686bf4426af (127.9.82.129). New cstate: current_term: 1 leader_uuid: "9c50595213a94b27a8bb4686bf4426af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.447602 23645 raft_consensus.cc:2781] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.447665 23645 raft_consensus.cc:686] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [term 1 LEADER]: Becoming Leader. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Running, Role: LEADER
I20240502 20:46:50.447796 23645 consensus_queue.cc:237] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.448174 23641 leader_election.cc:288] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.448494 23641 ts_tablet_manager.cc:1398] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:50.450516 23027 catalog_manager.cc:5484] T d8b19640eec846c6b48595ea22185756 P 9c50595213a94b27a8bb4686bf4426af reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c50595213a94b27a8bb4686bf4426af (127.9.82.129). New cstate: current_term: 1 leader_uuid: "9c50595213a94b27a8bb4686bf4426af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.636595 23027 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59610:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 20:46:50.643396 23148 tablet_service.cc:1467] Processing CreateTablet for tablet d659b9dab28d4a7f89c68cf272c7d9f9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=109f064e4f3b4e85a65a53f8236f9f4e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.643385 23280 tablet_service.cc:1467] Processing CreateTablet for tablet 7ba5de2f1c78482687067b852d322ef1 (DEFAULT_TABLE table=rebalance_test_table_3 [id=109f064e4f3b4e85a65a53f8236f9f4e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.643780 23148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d659b9dab28d4a7f89c68cf272c7d9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.643821 23280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ba5de2f1c78482687067b852d322ef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.643391 23279 tablet_service.cc:1467] Processing CreateTablet for tablet 5818d948c4da422eab34a4d217af7bd3 (DEFAULT_TABLE table=rebalance_test_table_3 [id=109f064e4f3b4e85a65a53f8236f9f4e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:50.644625 23279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5818d948c4da422eab34a4d217af7bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:50.646057 23641 tablet_bootstrap.cc:492] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af: Bootstrap starting.
I20240502 20:46:50.646301 23640 tablet_bootstrap.cc:492] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0: Bootstrap starting.
I20240502 20:46:50.646936 23641 tablet_bootstrap.cc:654] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.647505 23640 tablet_bootstrap.cc:654] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.648381 23641 tablet_bootstrap.cc:492] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af: No bootstrap required, opened a new log
I20240502 20:46:50.648460 23641 ts_tablet_manager.cc:1367] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:50.648809 23640 tablet_bootstrap.cc:492] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0: No bootstrap required, opened a new log
I20240502 20:46:50.648885 23640 ts_tablet_manager.cc:1367] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 20:46:50.648983 23641 raft_consensus.cc:348] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.649081 23641 raft_consensus.cc:374] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.649111 23641 raft_consensus.cc:729] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.649251 23641 consensus_queue.cc:260] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.649333 23641 raft_consensus.cc:388] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.649372 23641 raft_consensus.cc:482] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.649415 23641 raft_consensus.cc:3037] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.649358 23640 raft_consensus.cc:348] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.649457 23640 raft_consensus.cc:374] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.649489 23640 raft_consensus.cc:729] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.649624 23640 consensus_queue.cc:260] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.649721 23640 raft_consensus.cc:388] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.649753 23640 raft_consensus.cc:482] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.649791 23640 raft_consensus.cc:3037] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.650321 23641 raft_consensus.cc:504] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.650449 23641 leader_election.cc:302] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c50595213a94b27a8bb4686bf4426af; no voters:
I20240502 20:46:50.650703 23640 raft_consensus.cc:504] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.650830 23640 leader_election.cc:302] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6beb9b250c3f4b4993459b64027fc6d0; no voters:
I20240502 20:46:50.650880 23645 raft_consensus.cc:2781] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.650933 23640 leader_election.cc:288] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.650956 23645 raft_consensus.cc:686] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [term 1 LEADER]: Becoming Leader. State: Replica: 9c50595213a94b27a8bb4686bf4426af, State: Running, Role: LEADER
I20240502 20:46:50.651010 23648 raft_consensus.cc:2781] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.651067 23645 consensus_queue.cc:237] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } }
I20240502 20:46:50.651115 23648 raft_consensus.cc:686] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Running, Role: LEADER
I20240502 20:46:50.651158 23640 ts_tablet_manager.cc:1398] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:50.651252 23648 consensus_queue.cc:237] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.651329 23640 tablet_bootstrap.cc:492] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0: Bootstrap starting.
I20240502 20:46:50.652380 23641 leader_election.cc:288] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.652570 23640 tablet_bootstrap.cc:654] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:50.652732 23641 ts_tablet_manager.cc:1398] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240502 20:46:50.652822 23027 catalog_manager.cc:5484] T 7ba5de2f1c78482687067b852d322ef1 P 6beb9b250c3f4b4993459b64027fc6d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beb9b250c3f4b4993459b64027fc6d0 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "6beb9b250c3f4b4993459b64027fc6d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.653913 23640 tablet_bootstrap.cc:492] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0: No bootstrap required, opened a new log
I20240502 20:46:50.653995 23640 ts_tablet_manager.cc:1367] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:50.654381 23640 raft_consensus.cc:348] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.654462 23640 raft_consensus.cc:374] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:50.654493 23640 raft_consensus.cc:729] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Initialized, Role: FOLLOWER
I20240502 20:46:50.654603 23640 consensus_queue.cc:260] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.654691 23640 raft_consensus.cc:388] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:50.654722 23640 raft_consensus.cc:482] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:50.654759 23640 raft_consensus.cc:3037] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:50.655347 23026 catalog_manager.cc:5484] T d659b9dab28d4a7f89c68cf272c7d9f9 P 9c50595213a94b27a8bb4686bf4426af reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c50595213a94b27a8bb4686bf4426af (127.9.82.129). New cstate: current_term: 1 leader_uuid: "9c50595213a94b27a8bb4686bf4426af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c50595213a94b27a8bb4686bf4426af" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37235 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.655654 23640 raft_consensus.cc:504] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.655799 23640 leader_election.cc:302] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6beb9b250c3f4b4993459b64027fc6d0; no voters:
I20240502 20:46:50.655895 23640 leader_election.cc:288] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:50.655933 23646 raft_consensus.cc:2781] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:50.656001 23646 raft_consensus.cc:686] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [term 1 LEADER]: Becoming Leader. State: Replica: 6beb9b250c3f4b4993459b64027fc6d0, State: Running, Role: LEADER
I20240502 20:46:50.656152 23640 ts_tablet_manager.cc:1398] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:50.656105 23646 consensus_queue.cc:237] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } }
I20240502 20:46:50.659379 23026 catalog_manager.cc:5484] T 5818d948c4da422eab34a4d217af7bd3 P 6beb9b250c3f4b4993459b64027fc6d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6beb9b250c3f4b4993459b64027fc6d0 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "6beb9b250c3f4b4993459b64027fc6d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6beb9b250c3f4b4993459b64027fc6d0" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 41513 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:50.832671 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.131:40545
--local_ip_for_outbound_sockets=127.9.82.131
--tserver_master_addrs=127.9.82.190:41483
--webserver_port=41947
--webserver_interface=127.9.82.131
--builtin_ntp_servers=127.9.82.148:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:46:50.941359 23746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:50.941593 23746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:50.941643 23746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:50.944777 23746 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:50.944844 23746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:50.944924 23746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.131
I20240502 20:46:50.948642 23746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.131:40545
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.9.82.131
--webserver_port=41947
--tserver_master_addrs=127.9.82.190:41483
--never_fsync=true
--heap_profile_path=/tmp/kudu.23746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.131
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:50.949522 23746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:50.950677 23746 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:50.959303 23752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:50.959683 23751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:50.960245 23754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:50.961071 23746 server_base.cc:1034] running on GCE node
I20240502 20:46:50.961512 23746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:50.962133 23746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:50.963311 23746 hybrid_clock.cc:648] HybridClock initialized: now 1714682810963297 us; error 33 us; skew 500 ppm
I20240502 20:46:50.965497 23746 webserver.cc:460] Webserver started at http://127.9.82.131:41947/ using document root <none> and password file <none>
I20240502 20:46:50.966156 23746 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:50.966238 23746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:50.969990 23746 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 20:46:50.972131 23760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:50.973268 23746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:46:50.973372 23746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "8aaa4284ec1148d4b925fe625771cdfd"
format_stamp: "Formatted at 2024-05-02 20:46:45 on dist-test-slave-2pss"
I20240502 20:46:50.973831 23746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:50.987125 23746 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:50.987815 23746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:50.987977 23746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:50.988545 23746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:50.989461 23746 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:50.989509 23746 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:50.989570 23746 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:50.989598 23746 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:50.998025 23746 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.131:40545
I20240502 20:46:50.998064 23873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.131:40545 every 8 connection(s)
I20240502 20:46:50.999076 23746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 20:46:50.999255 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 23746
I20240502 20:46:50.999776 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.132:44783
--local_ip_for_outbound_sockets=127.9.82.132
--tserver_master_addrs=127.9.82.190:41483
--webserver_port=44167
--webserver_interface=127.9.82.132
--builtin_ntp_servers=127.9.82.148:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:46:51.009784 23874 heartbeater.cc:347] Connected to a master server at 127.9.82.190:41483
I20240502 20:46:51.010078 23874 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:51.010815 23874 heartbeater.cc:511] Master 127.9.82.190:41483 requested a full tablet report, sending...
I20240502 20:46:51.012073 23027 ts_manager.cc:194] Re-registered known tserver with Master: 8aaa4284ec1148d4b925fe625771cdfd (127.9.82.131:40545)
I20240502 20:46:51.012645 23027 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.131:53547
W20240502 20:46:51.114598 23877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:51.114861 23877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:51.114941 23877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:51.118036 23877 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:51.118130 23877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:51.118237 23877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.132
I20240502 20:46:51.121942 23877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.132:44783
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.9.82.132
--webserver_port=44167
--tserver_master_addrs=127.9.82.190:41483
--never_fsync=true
--heap_profile_path=/tmp/kudu.23877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.132
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:51.122891 23877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:51.124106 23877 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:51.132604 23882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:51.133090 23885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:51.133534 23883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:51.134387 23877 server_base.cc:1034] running on GCE node
I20240502 20:46:51.134850 23877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:51.135457 23877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:51.136621 23877 hybrid_clock.cc:648] HybridClock initialized: now 1714682811136593 us; error 49 us; skew 500 ppm
I20240502 20:46:51.138840 23877 webserver.cc:460] Webserver started at http://127.9.82.132:44167/ using document root <none> and password file <none>
I20240502 20:46:51.139446 23877 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:51.139526 23877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:51.143231 23877 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:46:51.145361 23891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:51.146339 23877 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:51.146450 23877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "d2b2106cae3c49c6b840295005224f96"
format_stamp: "Formatted at 2024-05-02 20:46:46 on dist-test-slave-2pss"
I20240502 20:46:51.146859 23877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:51.168475 23877 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:51.169103 23877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:51.169265 23877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:51.169796 23877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:51.170949 23898 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240502 20:46:51.174264 23877 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 20:46:51.174342 23877 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20240502 20:46:51.174422 23877 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 20:46:51.176024 23877 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 20:46:51.176091 23877 ts_tablet_manager.cc:569] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:51.176337 23898 tablet_bootstrap.cc:492] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Bootstrap starting.
I20240502 20:46:51.188277 23877 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.132:44783
I20240502 20:46:51.188298 24005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.132:44783 every 8 connection(s)
I20240502 20:46:51.189841 23877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 20:46:51.193176 23898 log.cc:824] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:51.195641 23898 tablet_bootstrap.cc:492] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:51.195997 23898 tablet_bootstrap.cc:492] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Bootstrap complete.
I20240502 20:46:51.197150 23898 ts_tablet_manager.cc:1367] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.013s
I20240502 20:46:51.197796 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 23877
I20240502 20:46:51.198807 24006 heartbeater.cc:347] Connected to a master server at 127.9.82.190:41483
I20240502 20:46:51.199043 24006 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:51.199563 24006 heartbeater.cc:511] Master 127.9.82.190:41483 requested a full tablet report, sending...
I20240502 20:46:51.200724 23898 raft_consensus.cc:348] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } }
I20240502 20:46:51.201071 23898 raft_consensus.cc:729] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2b2106cae3c49c6b840295005224f96, State: Initialized, Role: FOLLOWER
I20240502 20:46:51.201496 23898 consensus_queue.cc:260] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } }
I20240502 20:46:51.201562 23027 ts_manager.cc:194] Re-registered known tserver with Master: d2b2106cae3c49c6b840295005224f96 (127.9.82.132:44783)
I20240502 20:46:51.201613 23898 raft_consensus.cc:388] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:51.201678 23898 raft_consensus.cc:482] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:51.201783 23898 raft_consensus.cc:3037] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:46:51.202361 23027 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.132:60899
I20240502 20:46:51.203424 23898 raft_consensus.cc:504] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } }
I20240502 20:46:51.207806 23898 leader_election.cc:302] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2b2106cae3c49c6b840295005224f96; no voters:
I20240502 20:46:51.208112 23898 leader_election.cc:288] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 20:46:51.208317 24011 raft_consensus.cc:2781] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 20:46:51.208528 24011 raft_consensus.cc:686] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [term 2 LEADER]: Becoming Leader. State: Replica: d2b2106cae3c49c6b840295005224f96, State: Running, Role: LEADER
I20240502 20:46:51.208834 24011 consensus_queue.cc:237] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } }
I20240502 20:46:51.208906 24006 heartbeater.cc:503] Master 127.9.82.190:41483 was elected leader, sending a full tablet report...
I20240502 20:46:51.209192 23898 ts_tablet_manager.cc:1398] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96: Time spent starting tablet: real 0.012s user 0.006s sys 0.003s
I20240502 20:46:51.210953 23027 catalog_manager.cc:5484] T 2d33b26018424aa8ab87cd3fdc05a013 P d2b2106cae3c49c6b840295005224f96 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "d2b2106cae3c49c6b840295005224f96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b2106cae3c49c6b840295005224f96" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 44783 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:51.401504 23148 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:51.401634 23808 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:51.402225 23280 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:51.402812 23940 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:51.522454 23280 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:51.522756 23940 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:51.523509 23808 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:51.523540 23148 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:51.622332 23280 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:51.622349 23148 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:51.622882 23940 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 20:46:51.623296 23808 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+--------------------+---------
15c036958b4c4d7c8742d504e4fd77e9 | 127.9.82.190:41483 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+--------------------+-------------------------
builtin_ntp_servers | 127.9.82.148:46831 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+--------------------+---------+----------+----------------+-----------------
6beb9b250c3f4b4993459b64027fc6d0 | 127.9.82.130:41513 | HEALTHY | <none> | 6 | 0
8aaa4284ec1148d4b925fe625771cdfd | 127.9.82.131:40545 | HEALTHY | <none> | 0 | 0
9c50595213a94b27a8bb4686bf4426af | 127.9.82.129:37235 | HEALTHY | <none> | 6 | 0
d2b2106cae3c49c6b840295005224f96 | 127.9.82.132:44783 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 4 server(s) checked
local_ip_for_outbound_sockets | 127.9.82.129 | experimental | 127.9.82.129:37235
local_ip_for_outbound_sockets | 127.9.82.130 | experimental | 127.9.82.130:41513
local_ip_for_outbound_sockets | 127.9.82.131 | experimental | 127.9.82.131:40545
local_ip_for_outbound_sockets | 127.9.82.132 | experimental | 127.9.82.132:44783
never_fsync | true | unsafe,advanced | all 4 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 4 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 4 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
server_dump_info_format | pb | hidden | all 4 server(s) checked
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.9.82.129:37235
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.9.82.130:41513
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.9.82.131:40545
server_dump_info_path | /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.9.82.132:44783
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+--------------------+-------------------------
builtin_ntp_servers | 127.9.82.148:46831 | all 4 server(s) checked
time_source | builtin | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 1 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 1 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 1 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 1 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 6
Third Quartile | 6
Maximum | 6
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 5
Tablets | 13
Replicas | 13
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20240502 20:46:51.651530 9546 log_verifier.cc:126] Checking tablet 0fcb5f4188f7493e9d3e7b3861d648f6
I20240502 20:46:51.659453 9546 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 0fcb5f4188f7493e9d3e7b3861d648f6
I20240502 20:46:51.659516 9546 log_verifier.cc:126] Checking tablet 2d33b26018424aa8ab87cd3fdc05a013
I20240502 20:46:51.667470 9546 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 2d33b26018424aa8ab87cd3fdc05a013
I20240502 20:46:51.667539 9546 log_verifier.cc:126] Checking tablet 40b55bde55a642f0a23f99b492fa4b03
I20240502 20:46:51.674517 9546 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 40b55bde55a642f0a23f99b492fa4b03
I20240502 20:46:51.674583 9546 log_verifier.cc:126] Checking tablet 4a53208ad30a4b25b577226e6dc56492
I20240502 20:46:51.681790 9546 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 4a53208ad30a4b25b577226e6dc56492
I20240502 20:46:51.681856 9546 log_verifier.cc:126] Checking tablet 54913c1d772d4383b3edfaada767a6cd
I20240502 20:46:51.688823 9546 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 54913c1d772d4383b3edfaada767a6cd
I20240502 20:46:51.688880 9546 log_verifier.cc:126] Checking tablet 5818d948c4da422eab34a4d217af7bd3
I20240502 20:46:51.695694 9546 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 5818d948c4da422eab34a4d217af7bd3
I20240502 20:46:51.695765 9546 log_verifier.cc:126] Checking tablet 62017599d332463a9b9de56744ecdaa6
I20240502 20:46:51.702733 9546 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 62017599d332463a9b9de56744ecdaa6
I20240502 20:46:51.702788 9546 log_verifier.cc:126] Checking tablet 7ba5de2f1c78482687067b852d322ef1
I20240502 20:46:51.709767 9546 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 7ba5de2f1c78482687067b852d322ef1
I20240502 20:46:51.709825 9546 log_verifier.cc:126] Checking tablet 848fe657d16243ec815ca55c2d5c626d
I20240502 20:46:51.716835 9546 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 848fe657d16243ec815ca55c2d5c626d
I20240502 20:46:51.716890 9546 log_verifier.cc:126] Checking tablet 9b75f184e5194a4591a6fbcfad137171
I20240502 20:46:51.723965 9546 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 9b75f184e5194a4591a6fbcfad137171
I20240502 20:46:51.724018 9546 log_verifier.cc:126] Checking tablet aaa1be2cfe4c4c1d816d9891798dec98
I20240502 20:46:51.730921 9546 log_verifier.cc:177] Verified matching terms for 1 ops in tablet aaa1be2cfe4c4c1d816d9891798dec98
I20240502 20:46:51.730974 9546 log_verifier.cc:126] Checking tablet d659b9dab28d4a7f89c68cf272c7d9f9
I20240502 20:46:51.737874 9546 log_verifier.cc:177] Verified matching terms for 1 ops in tablet d659b9dab28d4a7f89c68cf272c7d9f9
I20240502 20:46:51.737929 9546 log_verifier.cc:126] Checking tablet d8b19640eec846c6b48595ea22185756
I20240502 20:46:51.744933 9546 log_verifier.cc:177] Verified matching terms for 1 ops in tablet d8b19640eec846c6b48595ea22185756
I20240502 20:46:51.745393 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 23087
I20240502 20:46:51.752208 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 23218
I20240502 20:46:51.758494 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 23746
I20240502 20:46:51.764106 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 23877
I20240502 20:46:51.769368 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 22996
2024-05-02T20:46:51Z chronyd exiting
[ OK ] RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove/5 (6642 ms)
[----------] 1 test from RebalancerAndSingleReplicaTablets (6642 ms total)
[----------] 2 tests from LocationAwareRebalancingParamTest
[ RUN ] LocationAwareRebalancingParamTest.Rebalance/idx7_rf2_t3_l_1_2_1
I20240502 20:46:51.803107 9546 test_util.cc:268] Using random seed: -1276746276
I20240502 20:46:51.803922 9546 ts_itest-base.cc:112] Starting cluster with:
I20240502 20:46:51.803962 9546 ts_itest-base.cc:113] --------------
I20240502 20:46:51.803974 9546 ts_itest-base.cc:114] 4 tablet servers
I20240502 20:46:51.803984 9546 ts_itest-base.cc:115] 2 replicas per TS
I20240502 20:46:51.803994 9546 ts_itest-base.cc:116] --------------
2024-05-02T20:46:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T20:46:51Z Disabled control of system clock
I20240502 20:46:51.813024 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:39051
--webserver_interface=127.9.82.190
--webserver_port=0
--builtin_ntp_servers=127.9.82.148:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.82.190:39051
--location_mapping_cmd=/tmp/dist-test-taskIC8fEc/build/debug/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/location-assignment.state --map /A:1 --map /B:2 --map /C:1
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false
--master_client_location_assignment_enabled=false
--allow_unsafe_replication_factor with env {}
W20240502 20:46:51.920595 24123 flags.cc:425] Enabled unsafe flag: --allow_unsafe_replication_factor=true
W20240502 20:46:51.920882 24123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:51.920940 24123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:51.921011 24123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:51.924049 24123 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:51.924135 24123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 20:46:51.924187 24123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:51.924221 24123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 20:46:51.924263 24123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 20:46:51.928077 24123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--allow_unsafe_replication_factor=true
--enable_range_replica_placement=false
--location_mapping_cmd=/tmp/dist-test-taskIC8fEc/build/debug/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/location-assignment.state --map /A:1 --map /B:2 --map /C:1
--ipki_ca_key_size=768
--master_addresses=127.9.82.190:39051
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:39051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.9.82.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.24123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:51.929006 24123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:51.930140 24123 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:51.937603 24131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:51.938041 24128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:51.938813 24129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:51.939502 24123 server_base.cc:1034] running on GCE node
I20240502 20:46:51.940136 24123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:51.941113 24123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:51.942337 24123 hybrid_clock.cc:648] HybridClock initialized: now 1714682811942324 us; error 29 us; skew 500 ppm
I20240502 20:46:51.944427 24123 webserver.cc:460] Webserver started at http://127.9.82.190:46087/ using document root <none> and password file <none>
I20240502 20:46:51.944978 24123 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:51.945042 24123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:51.945237 24123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:51.946902 24123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "5a80ce97710c4cd3b82cf896548b7499"
format_stamp: "Formatted at 2024-05-02 20:46:51 on dist-test-slave-2pss"
I20240502 20:46:51.947378 24123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "5a80ce97710c4cd3b82cf896548b7499"
format_stamp: "Formatted at 2024-05-02 20:46:51 on dist-test-slave-2pss"
I20240502 20:46:51.950740 24123 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 20:46:51.953019 24137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:51.953984 24123 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:51.954183 24123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
uuid: "5a80ce97710c4cd3b82cf896548b7499"
format_stamp: "Formatted at 2024-05-02 20:46:51 on dist-test-slave-2pss"
I20240502 20:46:51.954305 24123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:51.978678 24123 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:51.979377 24123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:51.979544 24123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:51.986299 24123 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.190:39051
I20240502 20:46:51.986320 24189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.190:39051 every 8 connection(s)
I20240502 20:46:51.987265 24123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 20:46:51.988407 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 24123
I20240502 20:46:51.988564 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 20:46:51.990335 24190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:51.996438 24190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499: Bootstrap starting.
I20240502 20:46:51.998785 24190 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:51.999609 24190 log.cc:824] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:52.001293 24190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499: No bootstrap required, opened a new log
I20240502 20:46:52.003942 24190 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a80ce97710c4cd3b82cf896548b7499" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39051 } }
I20240502 20:46:52.004139 24190 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:52.004225 24190 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a80ce97710c4cd3b82cf896548b7499, State: Initialized, Role: FOLLOWER
I20240502 20:46:52.004667 24190 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a80ce97710c4cd3b82cf896548b7499" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39051 } }
I20240502 20:46:52.004818 24190 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:46:52.004889 24190 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:46:52.005010 24190 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:52.005836 24190 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a80ce97710c4cd3b82cf896548b7499" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39051 } }
I20240502 20:46:52.006170 24190 leader_election.cc:302] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a80ce97710c4cd3b82cf896548b7499; no voters:
I20240502 20:46:52.006444 24190 leader_election.cc:288] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:46:52.006557 24195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:52.006784 24195 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [term 1 LEADER]: Becoming Leader. State: Replica: 5a80ce97710c4cd3b82cf896548b7499, State: Running, Role: LEADER
I20240502 20:46:52.007350 24195 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a80ce97710c4cd3b82cf896548b7499" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39051 } }
I20240502 20:46:52.007565 24190 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 20:46:52.008822 24197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a80ce97710c4cd3b82cf896548b7499" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a80ce97710c4cd3b82cf896548b7499" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39051 } } }
I20240502 20:46:52.008955 24197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [sys.catalog]: This master's current role is: LEADER
I20240502 20:46:52.009109 24196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a80ce97710c4cd3b82cf896548b7499. Latest consensus state: current_term: 1 leader_uuid: "5a80ce97710c4cd3b82cf896548b7499" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a80ce97710c4cd3b82cf896548b7499" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 39051 } } }
I20240502 20:46:52.009339 24204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 20:46:52.009470 24196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499 [sys.catalog]: This master's current role is: LEADER
I20240502 20:46:52.012084 24204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 20:46:52.016839 24204 catalog_manager.cc:1347] Generated new cluster ID: 1b0fc8f4e07b4178b44d0bff31d23d4e
I20240502 20:46:52.016911 24204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 20:46:52.027091 24204 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 20:46:52.028348 24204 catalog_manager.cc:1504] Loading token signing keys...
I20240502 20:46:52.040952 24204 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 5a80ce97710c4cd3b82cf896548b7499: Generated new TSK 0
I20240502 20:46:52.041796 24204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 20:46:52.046414 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.129:0
--local_ip_for_outbound_sockets=127.9.82.129
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39051
--builtin_ntp_servers=127.9.82.148:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:46:52.155527 24214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:52.155812 24214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:52.155885 24214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:52.159015 24214 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:52.159099 24214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:52.159216 24214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.129
I20240502 20:46:52.162878 24214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39051
--never_fsync=true
--heap_profile_path=/tmp/kudu.24214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.129
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:52.163820 24214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:52.164942 24214 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:52.173781 24219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:52.174257 24220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:52.174851 24222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:52.175412 24214 server_base.cc:1034] running on GCE node
I20240502 20:46:52.175802 24214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:52.176326 24214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:52.177466 24214 hybrid_clock.cc:648] HybridClock initialized: now 1714682812177448 us; error 36 us; skew 500 ppm
I20240502 20:46:52.179280 24214 webserver.cc:460] Webserver started at http://127.9.82.129:33327/ using document root <none> and password file <none>
I20240502 20:46:52.179836 24214 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:52.179893 24214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:52.180053 24214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:52.181620 24214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.182045 24214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.185189 24214 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 20:46:52.187283 24228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.188270 24214 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:52.188360 24214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.188431 24214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:52.219135 24214 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:52.219779 24214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:52.219925 24214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:52.220438 24214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:52.221287 24214 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:52.221333 24214 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.221371 24214 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:52.221393 24214 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.229965 24214 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.129:40657
I20240502 20:46:52.229995 24341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.129:40657 every 8 connection(s)
I20240502 20:46:52.230898 24214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 20:46:52.233232 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 24214
I20240502 20:46:52.233367 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 20:46:52.235782 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.130:0
--local_ip_for_outbound_sockets=127.9.82.130
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39051
--builtin_ntp_servers=127.9.82.148:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:46:52.240660 24342 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39051
I20240502 20:46:52.240881 24342 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:52.241393 24342 heartbeater.cc:511] Master 127.9.82.190:39051 requested a full tablet report, sending...
I20240502 20:46:52.279178 24154 ts_manager.cc:194] Registered new tserver with Master: f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:52.281193 24154 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.129:39563
W20240502 20:46:52.348923 24345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:52.349166 24345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:52.349211 24345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:52.352229 24345 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:52.352294 24345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:52.352365 24345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.130
I20240502 20:46:52.355907 24345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39051
--never_fsync=true
--heap_profile_path=/tmp/kudu.24345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.130
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:52.356771 24345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:52.357928 24345 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:52.366252 24354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:52.366606 24351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:52.367115 24352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:52.367926 24345 server_base.cc:1034] running on GCE node
I20240502 20:46:52.368320 24345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:52.368865 24345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:52.370045 24345 hybrid_clock.cc:648] HybridClock initialized: now 1714682812370024 us; error 32 us; skew 500 ppm
I20240502 20:46:52.371963 24345 webserver.cc:460] Webserver started at http://127.9.82.130:45667/ using document root <none> and password file <none>
I20240502 20:46:52.372478 24345 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:52.372530 24345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:52.372695 24345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:52.374269 24345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "7a28c3fffd6a4e52a614b015e61e9f82"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.374714 24345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "7a28c3fffd6a4e52a614b015e61e9f82"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.377908 24345 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 20:46:52.380386 24360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.381480 24345 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:46:52.381587 24345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "7a28c3fffd6a4e52a614b015e61e9f82"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.381697 24345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:52.404771 24345 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:52.405429 24345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:52.405594 24345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:52.406150 24345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:52.407032 24345 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:52.407084 24345 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.407157 24345 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:52.407186 24345 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.416682 24345 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.130:46361
I20240502 20:46:52.416725 24473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.130:46361 every 8 connection(s)
I20240502 20:46:52.417603 24345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 20:46:52.423112 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 24345
I20240502 20:46:52.423245 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 20:46:52.425371 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.131:0
--local_ip_for_outbound_sockets=127.9.82.131
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39051
--builtin_ntp_servers=127.9.82.148:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:46:52.426457 24474 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39051
I20240502 20:46:52.426683 24474 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:52.427296 24474 heartbeater.cc:511] Master 127.9.82.190:39051 requested a full tablet report, sending...
I20240502 20:46:52.468369 24154 ts_manager.cc:194] Registered new tserver with Master: 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130:46361)
I20240502 20:46:52.469106 24154 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.130:48655
W20240502 20:46:52.537736 24477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:52.537971 24477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:52.538041 24477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:52.541141 24477 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:52.541224 24477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:52.541317 24477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.131
I20240502 20:46:52.544936 24477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39051
--never_fsync=true
--heap_profile_path=/tmp/kudu.24477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.131
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:52.545872 24477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:52.546983 24477 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:52.555343 24483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:52.555826 24486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:52.556419 24484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:52.557024 24477 server_base.cc:1034] running on GCE node
I20240502 20:46:52.557425 24477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:52.557960 24477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:52.559123 24477 hybrid_clock.cc:648] HybridClock initialized: now 1714682812559112 us; error 26 us; skew 500 ppm
I20240502 20:46:52.561092 24477 webserver.cc:460] Webserver started at http://127.9.82.131:37773/ using document root <none> and password file <none>
I20240502 20:46:52.561671 24477 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:52.561734 24477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:52.561913 24477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:52.563534 24477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "ae2644a0309046aea365398895c9ece6"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.564026 24477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "ae2644a0309046aea365398895c9ece6"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.567188 24477 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20240502 20:46:52.569538 24492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.570616 24477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:52.570724 24477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "ae2644a0309046aea365398895c9ece6"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.570807 24477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:52.603560 24477 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:52.604283 24477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:52.604451 24477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:52.604991 24477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:52.605882 24477 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:52.605934 24477 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.605998 24477 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:52.606024 24477 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.615373 24477 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.131:43909
I20240502 20:46:52.615432 24605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.131:43909 every 8 connection(s)
I20240502 20:46:52.616647 24477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 20:46:52.618146 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 24477
I20240502 20:46:52.618235 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 20:46:52.620565 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.132:0
--local_ip_for_outbound_sockets=127.9.82.132
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39051
--builtin_ntp_servers=127.9.82.148:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:46:52.627660 24606 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39051
I20240502 20:46:52.627894 24606 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:52.628397 24606 heartbeater.cc:511] Master 127.9.82.190:39051 requested a full tablet report, sending...
I20240502 20:46:52.678613 24154 ts_manager.cc:194] Registered new tserver with Master: ae2644a0309046aea365398895c9ece6 (127.9.82.131:43909)
I20240502 20:46:52.679404 24154 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.131:54711
W20240502 20:46:52.751381 24609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:52.751597 24609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:52.751653 24609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:52.754673 24609 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:52.754739 24609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:52.754834 24609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.132
I20240502 20:46:52.758443 24609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:39051
--never_fsync=true
--heap_profile_path=/tmp/kudu.24609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.132
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:52.759330 24609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:52.760509 24609 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:52.768584 24615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:52.769207 24616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:52.769793 24618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:52.770349 24609 server_base.cc:1034] running on GCE node
I20240502 20:46:52.770797 24609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:52.771373 24609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:52.772534 24609 hybrid_clock.cc:648] HybridClock initialized: now 1714682812772523 us; error 27 us; skew 500 ppm
I20240502 20:46:52.774438 24609 webserver.cc:460] Webserver started at http://127.9.82.132:39583/ using document root <none> and password file <none>
I20240502 20:46:52.774976 24609 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:52.775032 24609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:52.775219 24609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:46:52.776912 24609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "1a7e96b0f12a433e81bd6c063c070d63"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.777359 24609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "1a7e96b0f12a433e81bd6c063c070d63"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.780639 24609 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 20:46:52.782742 24624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.783898 24609 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:46:52.783998 24609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "1a7e96b0f12a433e81bd6c063c070d63"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:52.784108 24609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:52.824352 24609 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:52.825026 24609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:52.825199 24609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:52.825779 24609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:52.826682 24609 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:52.826731 24609 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.826772 24609 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:52.826810 24609 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:52.835659 24609 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.132:34815
I20240502 20:46:52.835697 24737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.132:34815 every 8 connection(s)
I20240502 20:46:52.836658 24609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 20:46:52.838773 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 24609
I20240502 20:46:52.838896 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 20:46:52.846271 24738 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39051
I20240502 20:46:52.846496 24738 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:52.847003 24738 heartbeater.cc:511] Master 127.9.82.190:39051 requested a full tablet report, sending...
I20240502 20:46:52.881769 24154 ts_manager.cc:194] Registered new tserver with Master: 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:52.882556 24154 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.132:47505
I20240502 20:46:52.889312 9546 external_mini_cluster.cc:930] 4 TS(s) registered with all masters
I20240502 20:46:52.898792 9546 external_mini_cluster.cc:930] 4 TS(s) registered with all masters
I20240502 20:46:52.898870 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 24345
I20240502 20:46:52.905171 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 24477
I20240502 20:46:53.284435 24342 heartbeater.cc:503] Master 127.9.82.190:39051 was elected leader, sending a full tablet report...
I20240502 20:46:53.885011 24738 heartbeater.cc:503] Master 127.9.82.190:39051 was elected leader, sending a full tablet report...
I20240502 20:46:56.662530 24154 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44170:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:46:56.665882 24154 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_0 in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20240502 20:46:56.683141 24672 tablet_service.cc:1467] Processing CreateTablet for tablet 159c7836166a4bca9bb919a1664c3942 (DEFAULT_TABLE table=rebalance_test_table_0 [id=5b0fc51dc8c64b1e895b88948866803f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:56.683274 24274 tablet_service.cc:1467] Processing CreateTablet for tablet f0411bd818d341f28a1a0e42650fb8f3 (DEFAULT_TABLE table=rebalance_test_table_0 [id=5b0fc51dc8c64b1e895b88948866803f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:56.683141 24275 tablet_service.cc:1467] Processing CreateTablet for tablet a40bf08f27274741907ea48e193077a2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=5b0fc51dc8c64b1e895b88948866803f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:56.683141 24670 tablet_service.cc:1467] Processing CreateTablet for tablet a40bf08f27274741907ea48e193077a2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=5b0fc51dc8c64b1e895b88948866803f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:56.683279 24671 tablet_service.cc:1467] Processing CreateTablet for tablet f0411bd818d341f28a1a0e42650fb8f3 (DEFAULT_TABLE table=rebalance_test_table_0 [id=5b0fc51dc8c64b1e895b88948866803f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:56.683141 24276 tablet_service.cc:1467] Processing CreateTablet for tablet 159c7836166a4bca9bb919a1664c3942 (DEFAULT_TABLE table=rebalance_test_table_0 [id=5b0fc51dc8c64b1e895b88948866803f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:56.684255 24275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a40bf08f27274741907ea48e193077a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:56.684257 24672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 159c7836166a4bca9bb919a1664c3942. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:56.684608 24670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a40bf08f27274741907ea48e193077a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:56.684971 24671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0411bd818d341f28a1a0e42650fb8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:56.685591 24276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 159c7836166a4bca9bb919a1664c3942. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:56.685789 24274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f0411bd818d341f28a1a0e42650fb8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:56.691160 24756 tablet_bootstrap.cc:492] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: Bootstrap starting.
I20240502 20:46:56.691695 24755 tablet_bootstrap.cc:492] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Bootstrap starting.
I20240502 20:46:56.693681 24755 tablet_bootstrap.cc:654] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:56.694751 24755 log.cc:824] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:56.696664 24755 tablet_bootstrap.cc:492] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: No bootstrap required, opened a new log
I20240502 20:46:56.696847 24755 ts_tablet_manager.cc:1367] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20240502 20:46:56.697052 24756 tablet_bootstrap.cc:654] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:56.697845 24756 log.cc:824] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:56.699754 24756 tablet_bootstrap.cc:492] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: No bootstrap required, opened a new log
I20240502 20:46:56.699956 24756 ts_tablet_manager.cc:1367] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20240502 20:46:56.700217 24755 raft_consensus.cc:348] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.700479 24755 raft_consensus.cc:374] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:56.700564 24755 raft_consensus.cc:729] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Initialized, Role: FOLLOWER
I20240502 20:46:56.701028 24755 consensus_queue.cc:260] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.701983 24755 ts_tablet_manager.cc:1398] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 20:46:56.702345 24755 tablet_bootstrap.cc:492] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Bootstrap starting.
I20240502 20:46:56.703409 24755 tablet_bootstrap.cc:654] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:56.703635 24756 raft_consensus.cc:348] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.703943 24756 raft_consensus.cc:374] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:56.704021 24756 raft_consensus.cc:729] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Initialized, Role: FOLLOWER
I20240502 20:46:56.704502 24756 consensus_queue.cc:260] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.704998 24755 tablet_bootstrap.cc:492] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: No bootstrap required, opened a new log
I20240502 20:46:56.705121 24755 ts_tablet_manager.cc:1367] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:56.705497 24756 ts_tablet_manager.cc:1398] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 20:46:56.705724 24755 raft_consensus.cc:348] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.705821 24755 raft_consensus.cc:374] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:56.705852 24755 raft_consensus.cc:729] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Initialized, Role: FOLLOWER
I20240502 20:46:56.705860 24756 tablet_bootstrap.cc:492] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63: Bootstrap starting.
I20240502 20:46:56.705965 24755 consensus_queue.cc:260] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.706228 24755 ts_tablet_manager.cc:1398] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:56.706388 24755 tablet_bootstrap.cc:492] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Bootstrap starting.
I20240502 20:46:56.706852 24756 tablet_bootstrap.cc:654] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:56.707302 24755 tablet_bootstrap.cc:654] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:56.708516 24756 tablet_bootstrap.cc:492] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63: No bootstrap required, opened a new log
I20240502 20:46:56.708581 24755 tablet_bootstrap.cc:492] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: No bootstrap required, opened a new log
I20240502 20:46:56.708612 24756 ts_tablet_manager.cc:1367] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:56.708643 24755 ts_tablet_manager.cc:1367] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:56.709147 24755 raft_consensus.cc:348] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.709198 24756 raft_consensus.cc:348] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.709257 24755 raft_consensus.cc:374] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:56.709277 24756 raft_consensus.cc:374] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:56.709293 24755 raft_consensus.cc:729] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Initialized, Role: FOLLOWER
I20240502 20:46:56.709350 24756 raft_consensus.cc:729] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Initialized, Role: FOLLOWER
I20240502 20:46:56.709427 24755 consensus_queue.cc:260] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.709528 24756 consensus_queue.cc:260] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.709856 24756 ts_tablet_manager.cc:1398] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:56.709854 24755 ts_tablet_manager.cc:1398] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:56.710064 24756 tablet_bootstrap.cc:492] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63: Bootstrap starting.
I20240502 20:46:56.710907 24756 tablet_bootstrap.cc:654] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:56.712150 24756 tablet_bootstrap.cc:492] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63: No bootstrap required, opened a new log
I20240502 20:46:56.712235 24756 ts_tablet_manager.cc:1367] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:46:56.712596 24756 raft_consensus.cc:348] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.712663 24756 raft_consensus.cc:374] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:56.712683 24756 raft_consensus.cc:729] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Initialized, Role: FOLLOWER
I20240502 20:46:56.712780 24756 consensus_queue.cc:260] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.713009 24756 ts_tablet_manager.cc:1398] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20240502 20:46:56.735587 24343 tablet.cc:2369] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:46:56.772161 24759 raft_consensus.cc:482] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:56.772380 24759 raft_consensus.cc:504] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.773422 24759 leader_election.cc:288] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:56.778086 24692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "159c7836166a4bca9bb919a1664c3942" candidate_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7e96b0f12a433e81bd6c063c070d63" is_pre_election: true
I20240502 20:46:56.778390 24692 raft_consensus.cc:2454] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a2e74ce1ca4012b0ebe4ca080ba3fb in term 0.
I20240502 20:46:56.778925 24230 leader_election.cc:302] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:56.779212 24759 raft_consensus.cc:2781] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:56.779289 24759 raft_consensus.cc:482] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:56.779318 24759 raft_consensus.cc:3037] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:56.780282 24759 raft_consensus.cc:504] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.780589 24759 leader_election.cc:288] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 election: Requested vote from peers 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:56.780995 24692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "159c7836166a4bca9bb919a1664c3942" candidate_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7e96b0f12a433e81bd6c063c070d63"
I20240502 20:46:56.781111 24692 raft_consensus.cc:3037] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:56.781966 24692 raft_consensus.cc:2454] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a2e74ce1ca4012b0ebe4ca080ba3fb in term 1.
I20240502 20:46:56.782298 24230 leader_election.cc:302] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:56.782506 24759 raft_consensus.cc:2781] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:56.782603 24759 raft_consensus.cc:686] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Becoming Leader. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Running, Role: LEADER
I20240502 20:46:56.782912 24759 consensus_queue.cc:237] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.785969 24154 catalog_manager.cc:5484] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129). New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:56.840595 24739 tablet.cc:2369] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:46:56.941586 24761 raft_consensus.cc:482] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:56.941756 24761 raft_consensus.cc:504] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.942761 24761 leader_election.cc:288] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:56.946779 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0411bd818d341f28a1a0e42650fb8f3" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" is_pre_election: true
I20240502 20:46:56.946990 24296 raft_consensus.cc:2454] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 0.
I20240502 20:46:56.947459 24625 leader_election.cc:302] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:56.947768 24761 raft_consensus.cc:2781] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:56.947839 24761 raft_consensus.cc:482] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:56.947875 24761 raft_consensus.cc:3037] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:56.948719 24761 raft_consensus.cc:504] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.948989 24761 leader_election.cc:288] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Requested vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:56.949426 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0411bd818d341f28a1a0e42650fb8f3" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb"
I20240502 20:46:56.949548 24296 raft_consensus.cc:3037] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:56.950505 24296 raft_consensus.cc:2454] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 1.
I20240502 20:46:56.950856 24625 leader_election.cc:302] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:56.951026 24761 raft_consensus.cc:2781] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:56.951241 24761 raft_consensus.cc:686] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Running, Role: LEADER
I20240502 20:46:56.951601 24761 consensus_queue.cc:237] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.954773 24154 catalog_manager.cc:5484] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:56.955566 24761 raft_consensus.cc:482] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:56.955655 24761 raft_consensus.cc:504] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.955962 24761 leader_election.cc:288] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:56.956372 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a40bf08f27274741907ea48e193077a2" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" is_pre_election: true
I20240502 20:46:56.956499 24296 raft_consensus.cc:2454] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 0.
I20240502 20:46:56.956794 24625 leader_election.cc:302] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:56.957087 24761 raft_consensus.cc:2781] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:56.957178 24761 raft_consensus.cc:482] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:56.957222 24761 raft_consensus.cc:3037] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:56.958052 24761 raft_consensus.cc:504] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.958284 24761 leader_election.cc:288] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Requested vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:56.958715 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a40bf08f27274741907ea48e193077a2" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb"
I20240502 20:46:56.958833 24296 raft_consensus.cc:3037] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:56.959551 24296 raft_consensus.cc:2454] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 1.
I20240502 20:46:56.959858 24625 leader_election.cc:302] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:56.960057 24761 raft_consensus.cc:2781] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:56.960142 24761 raft_consensus.cc:686] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Running, Role: LEADER
I20240502 20:46:56.960274 24761 consensus_queue.cc:237] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:56.961769 24154 catalog_manager.cc:5484] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } }
W20240502 20:46:57.081033 24772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:57.081292 24772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:57.084306 24772 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_0'
I20240502 20:46:57.171988 24296 raft_consensus.cc:1261] T f0411bd818d341f28a1a0e42650fb8f3 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:57.171995 24295 raft_consensus.cc:1261] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:57.172933 24769 consensus_queue.cc:1035] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:57.173377 24769 consensus_queue.cc:1035] T f0411bd818d341f28a1a0e42650fb8f3 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:57.177664 24692 raft_consensus.cc:1261] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:57.178194 24759 consensus_queue.cc:1035] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:57.180295 24803 mvcc.cc:205] Tried to move back new op lower bound from 7023340819130011648 to 7023340818235965440. Current Snapshot: MvccSnapshot[applied={T|T < 7023340819130011648}]
I20240502 20:46:57.185860 24804 mvcc.cc:205] Tried to move back new op lower bound from 7023340819131441152 to 7023340818270154752. Current Snapshot: MvccSnapshot[applied={T|T < 7023340819131441152}]
INSERT report
rows total: 2000
time total: 88.118 ms
time per row: 0.044059 ms
I20240502 20:46:57.222858 24154 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44170:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:46:57.223345 24154 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_1 in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20240502 20:46:57.228281 24276 tablet_service.cc:1467] Processing CreateTablet for tablet 408c98b85a2e49199e1723d29a621797 (DEFAULT_TABLE table=rebalance_test_table_1 [id=84d42226de37466886abeca49c1d5c03]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.228441 24671 tablet_service.cc:1467] Processing CreateTablet for tablet e390db409933416699186d01bc5dce7f (DEFAULT_TABLE table=rebalance_test_table_1 [id=84d42226de37466886abeca49c1d5c03]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.228608 24276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 408c98b85a2e49199e1723d29a621797. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.228711 24671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e390db409933416699186d01bc5dce7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.228441 24670 tablet_service.cc:1467] Processing CreateTablet for tablet 408c98b85a2e49199e1723d29a621797 (DEFAULT_TABLE table=rebalance_test_table_1 [id=84d42226de37466886abeca49c1d5c03]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.229034 24670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 408c98b85a2e49199e1723d29a621797. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.229863 24672 tablet_service.cc:1467] Processing CreateTablet for tablet f013826a7f06472b9704b16a26885074 (DEFAULT_TABLE table=rebalance_test_table_1 [id=84d42226de37466886abeca49c1d5c03]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.230080 24672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f013826a7f06472b9704b16a26885074. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.230825 24818 tablet_bootstrap.cc:492] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63: Bootstrap starting.
I20240502 20:46:57.231473 24818 tablet_bootstrap.cc:654] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.232175 24817 tablet_bootstrap.cc:492] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Bootstrap starting.
I20240502 20:46:57.232184 24276 tablet_service.cc:1467] Processing CreateTablet for tablet e390db409933416699186d01bc5dce7f (DEFAULT_TABLE table=rebalance_test_table_1 [id=84d42226de37466886abeca49c1d5c03]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.232439 24276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e390db409933416699186d01bc5dce7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.232621 24275 tablet_service.cc:1467] Processing CreateTablet for tablet f013826a7f06472b9704b16a26885074 (DEFAULT_TABLE table=rebalance_test_table_1 [id=84d42226de37466886abeca49c1d5c03]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.232846 24275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f013826a7f06472b9704b16a26885074. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.233052 24817 tablet_bootstrap.cc:654] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.234006 24817 tablet_bootstrap.cc:492] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: No bootstrap required, opened a new log
I20240502 20:46:57.234087 24817 ts_tablet_manager.cc:1367] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:57.234494 24817 raft_consensus.cc:348] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.234598 24817 raft_consensus.cc:374] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.234649 24817 raft_consensus.cc:729] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.234774 24817 consensus_queue.cc:260] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.235023 24817 ts_tablet_manager.cc:1398] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:57.235188 24817 tablet_bootstrap.cc:492] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Bootstrap starting.
I20240502 20:46:57.235965 24818 tablet_bootstrap.cc:492] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63: No bootstrap required, opened a new log
I20240502 20:46:57.235999 24817 tablet_bootstrap.cc:654] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.236055 24818 ts_tablet_manager.cc:1367] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:46:57.236550 24818 raft_consensus.cc:348] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.236654 24818 raft_consensus.cc:374] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.236696 24818 raft_consensus.cc:729] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.236809 24818 consensus_queue.cc:260] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.237051 24818 ts_tablet_manager.cc:1398] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:57.237216 24818 tablet_bootstrap.cc:492] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63: Bootstrap starting.
I20240502 20:46:57.237811 24817 tablet_bootstrap.cc:492] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb: No bootstrap required, opened a new log
I20240502 20:46:57.237896 24817 ts_tablet_manager.cc:1367] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240502 20:46:57.238272 24817 raft_consensus.cc:348] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.238364 24818 tablet_bootstrap.cc:654] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.238395 24817 raft_consensus.cc:374] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.238425 24817 raft_consensus.cc:729] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.238546 24817 consensus_queue.cc:260] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.238822 24817 ts_tablet_manager.cc:1398] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:46:57.238987 24817 tablet_bootstrap.cc:492] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Bootstrap starting.
I20240502 20:46:57.239953 24817 tablet_bootstrap.cc:654] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.240541 24818 tablet_bootstrap.cc:492] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63: No bootstrap required, opened a new log
I20240502 20:46:57.240767 24818 ts_tablet_manager.cc:1367] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:46:57.241243 24817 tablet_bootstrap.cc:492] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: No bootstrap required, opened a new log
I20240502 20:46:57.241225 24818 raft_consensus.cc:348] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.241309 24818 raft_consensus.cc:374] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.241324 24817 ts_tablet_manager.cc:1367] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:46:57.241335 24818 raft_consensus.cc:729] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.241456 24818 consensus_queue.cc:260] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.241703 24818 ts_tablet_manager.cc:1398] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:57.241739 24817 raft_consensus.cc:348] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.241825 24817 raft_consensus.cc:374] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.241839 24818 tablet_bootstrap.cc:492] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63: Bootstrap starting.
I20240502 20:46:57.241855 24817 raft_consensus.cc:729] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.241968 24817 consensus_queue.cc:260] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.242254 24817 ts_tablet_manager.cc:1398] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 20:46:57.242728 24818 tablet_bootstrap.cc:654] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.243618 24818 tablet_bootstrap.cc:492] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63: No bootstrap required, opened a new log
I20240502 20:46:57.243685 24818 ts_tablet_manager.cc:1367] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:57.244084 24818 raft_consensus.cc:348] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.244172 24818 raft_consensus.cc:374] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.244216 24818 raft_consensus.cc:729] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.244307 24818 consensus_queue.cc:260] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.244530 24818 ts_tablet_manager.cc:1398] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:57.271519 24769 raft_consensus.cc:482] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:57.271651 24769 raft_consensus.cc:504] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.272022 24769 leader_election.cc:288] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:57.272466 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e390db409933416699186d01bc5dce7f" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" is_pre_election: true
I20240502 20:46:57.272610 24296 raft_consensus.cc:2454] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 0.
I20240502 20:46:57.272747 24769 raft_consensus.cc:482] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:57.272866 24769 raft_consensus.cc:504] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.273000 24625 leader_election.cc:302] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.273162 24769 leader_election.cc:288] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:57.273175 24761 raft_consensus.cc:2781] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:57.273263 24761 raft_consensus.cc:482] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:57.273322 24761 raft_consensus.cc:3037] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.274120 24761 raft_consensus.cc:504] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.274358 24761 leader_election.cc:288] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Requested vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:57.274544 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408c98b85a2e49199e1723d29a621797" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" is_pre_election: true
I20240502 20:46:57.274658 24296 raft_consensus.cc:2454] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 0.
I20240502 20:46:57.274686 24295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e390db409933416699186d01bc5dce7f" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb"
I20240502 20:46:57.274758 24295 raft_consensus.cc:3037] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.274911 24625 leader_election.cc:302] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.275099 24761 raft_consensus.cc:2781] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:57.275161 24761 raft_consensus.cc:482] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:57.275204 24761 raft_consensus.cc:3037] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.275748 24295 raft_consensus.cc:2454] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 1.
I20240502 20:46:57.276041 24625 leader_election.cc:302] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.276083 24761 raft_consensus.cc:504] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.276255 24769 raft_consensus.cc:2781] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:57.276307 24761 leader_election.cc:288] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Requested vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:57.276475 24769 raft_consensus.cc:686] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Running, Role: LEADER
I20240502 20:46:57.276648 24295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408c98b85a2e49199e1723d29a621797" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb"
I20240502 20:46:57.276652 24769 consensus_queue.cc:237] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.276733 24295 raft_consensus.cc:3037] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.277449 24295 raft_consensus.cc:2454] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 1.
I20240502 20:46:57.277729 24625 leader_election.cc:302] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.277890 24825 raft_consensus.cc:2781] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:57.277973 24825 raft_consensus.cc:686] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Running, Role: LEADER
I20240502 20:46:57.278092 24825 consensus_queue.cc:237] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.278262 24152 catalog_manager.cc:5484] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:57.281363 24154 catalog_manager.cc:5484] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240502 20:46:57.434228 24764 raft_consensus.cc:482] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:57.434384 24764 raft_consensus.cc:504] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.434791 24764 leader_election.cc:288] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:57.435333 24692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f013826a7f06472b9704b16a26885074" candidate_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7e96b0f12a433e81bd6c063c070d63" is_pre_election: true
I20240502 20:46:57.435467 24692 raft_consensus.cc:2454] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a2e74ce1ca4012b0ebe4ca080ba3fb in term 0.
I20240502 20:46:57.435887 24230 leader_election.cc:302] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.436106 24764 raft_consensus.cc:2781] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:57.436163 24764 raft_consensus.cc:482] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:57.436189 24764 raft_consensus.cc:3037] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.437031 24764 raft_consensus.cc:504] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.437288 24764 leader_election.cc:288] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 election: Requested vote from peers 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:57.437819 24692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f013826a7f06472b9704b16a26885074" candidate_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7e96b0f12a433e81bd6c063c070d63"
I20240502 20:46:57.437955 24692 raft_consensus.cc:3037] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.438753 24692 raft_consensus.cc:2454] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a2e74ce1ca4012b0ebe4ca080ba3fb in term 1.
I20240502 20:46:57.439051 24230 leader_election.cc:302] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.439270 24764 raft_consensus.cc:2781] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:57.439373 24764 raft_consensus.cc:686] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Becoming Leader. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Running, Role: LEADER
I20240502 20:46:57.439515 24764 consensus_queue.cc:237] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.441380 24154 catalog_manager.cc:5484] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129). New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: HEALTHY } } }
W20240502 20:46:57.576216 24829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:57.576474 24829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:57.579490 24829 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_1'
I20240502 20:46:57.666234 24295 raft_consensus.cc:1261] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:57.666811 24825 consensus_queue.cc:1035] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:57.668200 24296 raft_consensus.cc:1261] T 408c98b85a2e49199e1723d29a621797 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:57.669684 24769 consensus_queue.cc:1035] T 408c98b85a2e49199e1723d29a621797 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:57.670365 24692 raft_consensus.cc:1261] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:57.672174 24759 consensus_queue.cc:1035] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 83.9195 ms
time per row: 0.0419598 ms
I20240502 20:46:57.715428 24154 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44170:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:46:57.715984 24154 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_2 in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20240502 20:46:57.721261 24672 tablet_service.cc:1467] Processing CreateTablet for tablet edac54600a5b47aab10e615dc7c68a6a (DEFAULT_TABLE table=rebalance_test_table_2 [id=be64d8d4ee104e5f924e60f9df0251a4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.721460 24670 tablet_service.cc:1467] Processing CreateTablet for tablet 40cf767806ce4488b67fe28b454df051 (DEFAULT_TABLE table=rebalance_test_table_2 [id=be64d8d4ee104e5f924e60f9df0251a4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.721573 24672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edac54600a5b47aab10e615dc7c68a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.721776 24275 tablet_service.cc:1467] Processing CreateTablet for tablet edac54600a5b47aab10e615dc7c68a6a (DEFAULT_TABLE table=rebalance_test_table_2 [id=be64d8d4ee104e5f924e60f9df0251a4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.721940 24276 tablet_service.cc:1467] Processing CreateTablet for tablet 40cf767806ce4488b67fe28b454df051 (DEFAULT_TABLE table=rebalance_test_table_2 [id=be64d8d4ee104e5f924e60f9df0251a4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.722041 24275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edac54600a5b47aab10e615dc7c68a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.722138 24276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40cf767806ce4488b67fe28b454df051. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.722155 24274 tablet_service.cc:1467] Processing CreateTablet for tablet 4f08d1f3e8e345c1a5245e8bbebab524 (DEFAULT_TABLE table=rebalance_test_table_2 [id=be64d8d4ee104e5f924e60f9df0251a4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.722429 24274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f08d1f3e8e345c1a5245e8bbebab524. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.723912 24818 tablet_bootstrap.cc:492] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63: Bootstrap starting.
I20240502 20:46:57.724416 24670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40cf767806ce4488b67fe28b454df051. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.724432 24817 tablet_bootstrap.cc:492] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Bootstrap starting.
I20240502 20:46:57.724609 24672 tablet_service.cc:1467] Processing CreateTablet for tablet 4f08d1f3e8e345c1a5245e8bbebab524 (DEFAULT_TABLE table=rebalance_test_table_2 [id=be64d8d4ee104e5f924e60f9df0251a4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:46:57.724833 24672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f08d1f3e8e345c1a5245e8bbebab524. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:57.725338 24817 tablet_bootstrap.cc:654] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.726648 24817 tablet_bootstrap.cc:492] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: No bootstrap required, opened a new log
I20240502 20:46:57.726740 24817 ts_tablet_manager.cc:1367] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:57.726907 24818 tablet_bootstrap.cc:654] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.727154 24817 raft_consensus.cc:348] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.727248 24817 raft_consensus.cc:374] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.727281 24817 raft_consensus.cc:729] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.727439 24817 consensus_queue.cc:260] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.727713 24817 ts_tablet_manager.cc:1398] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 20:46:57.727990 24817 tablet_bootstrap.cc:492] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Bootstrap starting.
I20240502 20:46:57.727991 24818 tablet_bootstrap.cc:492] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63: No bootstrap required, opened a new log
I20240502 20:46:57.728075 24818 ts_tablet_manager.cc:1367] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:46:57.728533 24818 raft_consensus.cc:348] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.728636 24818 raft_consensus.cc:374] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.728672 24818 raft_consensus.cc:729] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.728796 24818 consensus_queue.cc:260] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.729048 24818 ts_tablet_manager.cc:1398] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:57.729087 24817 tablet_bootstrap.cc:654] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.729297 24818 tablet_bootstrap.cc:492] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63: Bootstrap starting.
I20240502 20:46:57.730155 24818 tablet_bootstrap.cc:654] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.730322 24817 tablet_bootstrap.cc:492] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: No bootstrap required, opened a new log
I20240502 20:46:57.730412 24817 ts_tablet_manager.cc:1367] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:57.730909 24817 raft_consensus.cc:348] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.731001 24817 raft_consensus.cc:374] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.731035 24817 raft_consensus.cc:729] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.731191 24817 consensus_queue.cc:260] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.731523 24817 ts_tablet_manager.cc:1398] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:57.731792 24818 tablet_bootstrap.cc:492] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63: No bootstrap required, opened a new log
I20240502 20:46:57.731880 24818 ts_tablet_manager.cc:1367] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:46:57.732124 24817 tablet_bootstrap.cc:492] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Bootstrap starting.
I20240502 20:46:57.732318 24818 raft_consensus.cc:348] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.733018 24818 raft_consensus.cc:374] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.733028 24817 tablet_bootstrap.cc:654] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.733053 24818 raft_consensus.cc:729] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.733186 24818 consensus_queue.cc:260] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.734244 24817 tablet_bootstrap.cc:492] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb: No bootstrap required, opened a new log
I20240502 20:46:57.734320 24817 ts_tablet_manager.cc:1367] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:46:57.734035 24818 ts_tablet_manager.cc:1398] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:57.734712 24818 tablet_bootstrap.cc:492] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63: Bootstrap starting.
I20240502 20:46:57.734879 24817 raft_consensus.cc:348] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.734961 24817 raft_consensus.cc:374] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.734997 24817 raft_consensus.cc:729] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.735116 24817 consensus_queue.cc:260] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.735365 24817 ts_tablet_manager.cc:1398] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:57.735579 24818 tablet_bootstrap.cc:654] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63: Neither blocks nor log segments found. Creating new log.
I20240502 20:46:57.736771 24818 tablet_bootstrap.cc:492] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63: No bootstrap required, opened a new log
I20240502 20:46:57.736861 24818 ts_tablet_manager.cc:1367] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:46:57.737253 24818 raft_consensus.cc:348] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.737349 24818 raft_consensus.cc:374] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:46:57.737372 24818 raft_consensus.cc:729] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Initialized, Role: FOLLOWER
I20240502 20:46:57.737501 24818 consensus_queue.cc:260] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.737792 24818 ts_tablet_manager.cc:1398] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:46:57.799156 24759 raft_consensus.cc:482] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:57.799301 24759 raft_consensus.cc:504] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.799651 24759 leader_election.cc:288] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:57.800295 24692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f08d1f3e8e345c1a5245e8bbebab524" candidate_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7e96b0f12a433e81bd6c063c070d63" is_pre_election: true
I20240502 20:46:57.800555 24692 raft_consensus.cc:2454] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a2e74ce1ca4012b0ebe4ca080ba3fb in term 0.
I20240502 20:46:57.800983 24230 leader_election.cc:302] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.801167 24759 raft_consensus.cc:2781] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:57.801234 24759 raft_consensus.cc:482] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:57.801271 24759 raft_consensus.cc:3037] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.802145 24759 raft_consensus.cc:504] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.802419 24759 leader_election.cc:288] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 election: Requested vote from peers 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:57.802852 24692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f08d1f3e8e345c1a5245e8bbebab524" candidate_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7e96b0f12a433e81bd6c063c070d63"
I20240502 20:46:57.802995 24692 raft_consensus.cc:3037] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.803857 24692 raft_consensus.cc:2454] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8a2e74ce1ca4012b0ebe4ca080ba3fb in term 1.
I20240502 20:46:57.804198 24230 leader_election.cc:302] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.804411 24759 raft_consensus.cc:2781] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:57.804517 24759 raft_consensus.cc:686] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Becoming Leader. State: Replica: f8a2e74ce1ca4012b0ebe4ca080ba3fb, State: Running, Role: LEADER
I20240502 20:46:57.804661 24759 consensus_queue.cc:237] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } }
I20240502 20:46:57.806447 24154 catalog_manager.cc:5484] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb reported cstate change: term changed from 0 to 1, leader changed from <none> to f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129). New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:57.855835 24825 raft_consensus.cc:482] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:57.855980 24825 raft_consensus.cc:504] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.856362 24825 leader_election.cc:288] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:57.856889 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40cf767806ce4488b67fe28b454df051" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" is_pre_election: true
I20240502 20:46:57.857045 24296 raft_consensus.cc:2454] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 0.
I20240502 20:46:57.857396 24625 leader_election.cc:302] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.857594 24825 raft_consensus.cc:2781] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:57.857692 24825 raft_consensus.cc:482] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:57.857734 24825 raft_consensus.cc:3037] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.858994 24825 raft_consensus.cc:504] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.859282 24825 leader_election.cc:288] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Requested vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:57.859699 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40cf767806ce4488b67fe28b454df051" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb"
I20240502 20:46:57.859853 24296 raft_consensus.cc:3037] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:57.860872 24296 raft_consensus.cc:2454] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 1.
I20240502 20:46:57.861212 24625 leader_election.cc:302] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:57.861419 24825 raft_consensus.cc:2781] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:57.861498 24825 raft_consensus.cc:686] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Running, Role: LEADER
I20240502 20:46:57.861632 24825 consensus_queue.cc:237] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:57.863919 24154 catalog_manager.cc:5484] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:58.027935 24825 raft_consensus.cc:482] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:46:58.028105 24825 raft_consensus.cc:504] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:58.028458 24825 leader_election.cc:288] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:58.029042 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edac54600a5b47aab10e615dc7c68a6a" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" is_pre_election: true
I20240502 20:46:58.029201 24296 raft_consensus.cc:2454] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 0.
I20240502 20:46:58.029536 24625 leader_election.cc:302] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:58.029798 24825 raft_consensus.cc:2781] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:46:58.029866 24825 raft_consensus.cc:482] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:46:58.029893 24825 raft_consensus.cc:3037] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:58.030725 24825 raft_consensus.cc:504] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:58.031021 24825 leader_election.cc:288] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Requested vote from peers f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:58.031517 24296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edac54600a5b47aab10e615dc7c68a6a" candidate_uuid: "1a7e96b0f12a433e81bd6c063c070d63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb"
I20240502 20:46:58.031644 24296 raft_consensus.cc:3037] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:46:58.032483 24296 raft_consensus.cc:2454] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7e96b0f12a433e81bd6c063c070d63 in term 1.
I20240502 20:46:58.032871 24625 leader_election.cc:302] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 1a7e96b0f12a433e81bd6c063c070d63, f8a2e74ce1ca4012b0ebe4ca080ba3fb; no voters:
I20240502 20:46:58.033079 24825 raft_consensus.cc:2781] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:46:58.033200 24825 raft_consensus.cc:686] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7e96b0f12a433e81bd6c063c070d63, State: Running, Role: LEADER
I20240502 20:46:58.033332 24825 consensus_queue.cc:237] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } }
I20240502 20:46:58.035058 24154 catalog_manager.cc:5484] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: UNKNOWN } } }
W20240502 20:46:58.198175 24866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:58.198495 24866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:58.201594 24866 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 20:46:58.220430 24759 consensus_queue.cc:1035] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_2'
I20240502 20:46:58.290841 24296 raft_consensus.cc:1261] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:58.291383 24769 consensus_queue.cc:1035] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:46:58.295109 24294 raft_consensus.cc:1261] T 40cf767806ce4488b67fe28b454df051 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:46:58.295567 24769 consensus_queue.cc:1035] T 40cf767806ce4488b67fe28b454df051 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 88.3905 ms
time per row: 0.0441953 ms
I20240502 20:46:58.334687 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.130:46361
--local_ip_for_outbound_sockets=127.9.82.130
--tserver_master_addrs=127.9.82.190:39051
--webserver_port=45667
--webserver_interface=127.9.82.130
--builtin_ntp_servers=127.9.82.148:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:46:58.445112 24913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:58.445345 24913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:58.445390 24913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:58.448554 24913 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:58.448627 24913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:58.448720 24913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.130
I20240502 20:46:58.452332 24913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.130:46361
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.9.82.130
--webserver_port=45667
--tserver_master_addrs=127.9.82.190:39051
--never_fsync=true
--heap_profile_path=/tmp/kudu.24913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.130
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:58.453253 24913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:58.454397 24913 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:58.463642 24918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:58.464145 24921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:58.464593 24913 server_base.cc:1034] running on GCE node
W20240502 20:46:58.465327 24919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:58.465842 24913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:58.466482 24913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:58.467664 24913 hybrid_clock.cc:648] HybridClock initialized: now 1714682818467648 us; error 36 us; skew 500 ppm
I20240502 20:46:58.469884 24913 webserver.cc:460] Webserver started at http://127.9.82.130:45667/ using document root <none> and password file <none>
I20240502 20:46:58.470499 24913 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:58.470584 24913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:58.474351 24913 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20240502 20:46:58.476575 24927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:58.477821 24913 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 20:46:58.477953 24913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "7a28c3fffd6a4e52a614b015e61e9f82"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:58.478443 24913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:58.503630 24913 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:58.504398 24913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:58.504585 24913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:58.505192 24913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:58.506162 24913 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:58.506227 24913 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:58.506297 24913 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:58.506330 24913 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:58.516217 24913 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.130:46361
I20240502 20:46:58.516263 25040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.130:46361 every 8 connection(s)
I20240502 20:46:58.517364 24913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 20:46:58.521718 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 24913
I20240502 20:46:58.522163 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.131:43909
--local_ip_for_outbound_sockets=127.9.82.131
--tserver_master_addrs=127.9.82.190:39051
--webserver_port=37773
--webserver_interface=127.9.82.131
--builtin_ntp_servers=127.9.82.148:38453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:46:58.527333 25041 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39051
I20240502 20:46:58.527621 25041 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:58.528357 25041 heartbeater.cc:511] Master 127.9.82.190:39051 requested a full tablet report, sending...
I20240502 20:46:58.530211 24145 ts_manager.cc:194] Re-registered known tserver with Master: 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130:46361)
I20240502 20:46:58.531286 24145 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.130:44209
W20240502 20:46:58.632344 25044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:46:58.632570 25044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:46:58.632639 25044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:46:58.635677 25044 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:46:58.635784 25044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:46:58.635897 25044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.131
I20240502 20:46:58.639516 25044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:38453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.131:43909
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.9.82.131
--webserver_port=37773
--tserver_master_addrs=127.9.82.190:39051
--never_fsync=true
--heap_profile_path=/tmp/kudu.25044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.131
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:46:58.640532 25044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:46:58.641664 25044 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:46:58.650359 25049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:58.650897 25050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:46:58.651473 25052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:46:58.652017 25044 server_base.cc:1034] running on GCE node
I20240502 20:46:58.652493 25044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:46:58.653141 25044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:46:58.654323 25044 hybrid_clock.cc:648] HybridClock initialized: now 1714682818654295 us; error 43 us; skew 500 ppm
I20240502 20:46:58.656572 25044 webserver.cc:460] Webserver started at http://127.9.82.131:37773/ using document root <none> and password file <none>
I20240502 20:46:58.657248 25044 fs_manager.cc:359] Metadata directory not provided
I20240502 20:46:58.657330 25044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:46:58.660879 25044 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.002s
I20240502 20:46:58.662981 25058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:58.664152 25044 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 20:46:58.664283 25044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "ae2644a0309046aea365398895c9ece6"
format_stamp: "Formatted at 2024-05-02 20:46:52 on dist-test-slave-2pss"
I20240502 20:46:58.664731 25044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:46:58.687808 25044 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:46:58.688437 25044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:46:58.688622 25044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:46:58.689201 25044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:46:58.690079 25044 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:46:58.690126 25044 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:58.690166 25044 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:46:58.690208 25044 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:46:58.699457 25044 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.131:43909
I20240502 20:46:58.699493 25171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.131:43909 every 8 connection(s)
I20240502 20:46:58.700542 25044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 20:46:58.709515 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 25044
I20240502 20:46:58.709800 25172 heartbeater.cc:347] Connected to a master server at 127.9.82.190:39051
I20240502 20:46:58.710027 25172 heartbeater.cc:464] Registering TS with master...
I20240502 20:46:58.710558 25172 heartbeater.cc:511] Master 127.9.82.190:39051 requested a full tablet report, sending...
I20240502 20:46:58.711714 24145 ts_manager.cc:194] Re-registered known tserver with Master: ae2644a0309046aea365398895c9ece6 (127.9.82.131:43909)
I20240502 20:46:58.712558 24145 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.131:32901
I20240502 20:46:58.912077 24672 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:58.912395 24975 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:58.912820 24275 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:58.913182 25105 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:59.016376 24975 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:59.016381 25105 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:59.016753 24672 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:59.017941 24275 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:59.135548 25105 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:59.135656 24975 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:59.135912 24672 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:59.136412 24275 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:59.223030 24975 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:59.223819 24672 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:46:59.224597 24275 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:46:59.224591 25105 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:46:59.266613 24692 consensus_queue.cc:237] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } }
I20240502 20:46:59.268509 24294 raft_consensus.cc:1261] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:59.269050 25313 consensus_queue.cc:1035] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:59.270946 24912 raft_consensus.cc:2932] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } } }
I20240502 20:46:59.271353 24294 raft_consensus.cc:2932] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } } }
W20240502 20:46:59.272219 24625 consensus_peers.cc:485] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 -> Peer 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130:46361): Couldn't send request to peer 7a28c3fffd6a4e52a614b015e61e9f82. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: edac54600a5b47aab10e615dc7c68a6a. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:59.274003 24154 catalog_manager.cc:5484] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index -1 to 4, NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) added. New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:59.281919 24294 consensus_queue.cc:237] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } }
I20240502 20:46:59.283396 24692 raft_consensus.cc:1261] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:59.283859 25327 consensus_queue.cc:1035] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:59.285899 24759 raft_consensus.cc:2932] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER ae2644a0309046aea365398895c9ece6 (127.9.82.131) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } } }
I20240502 20:46:59.286361 24692 raft_consensus.cc:2932] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER ae2644a0309046aea365398895c9ece6 (127.9.82.131) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } } }
W20240502 20:46:59.287959 24229 consensus_peers.cc:485] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb -> Peer ae2644a0309046aea365398895c9ece6 (127.9.82.131:43909): Couldn't send request to peer ae2644a0309046aea365398895c9ece6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f013826a7f06472b9704b16a26885074. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:59.288856 24154 catalog_manager.cc:5484] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index -1 to 4, NON_VOTER ae2644a0309046aea365398895c9ece6 (127.9.82.131) added. New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } } }
I20240502 20:46:59.296384 24692 consensus_queue.cc:237] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } }
I20240502 20:46:59.297680 24294 raft_consensus.cc:1261] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:46:59.297938 24625 consensus_peers.cc:485] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 -> Peer 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130:46361): Couldn't send request to peer 7a28c3fffd6a4e52a614b015e61e9f82. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e390db409933416699186d01bc5dce7f. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:59.298175 25316 consensus_queue.cc:1035] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:59.300022 24912 raft_consensus.cc:2932] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } } }
I20240502 20:46:59.300493 24294 raft_consensus.cc:2932] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } } }
I20240502 20:46:59.302440 24152 catalog_manager.cc:5484] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index -1 to 4, NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) added. New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:59.310468 24294 consensus_queue.cc:237] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } }
I20240502 20:46:59.311555 24692 raft_consensus.cc:1261] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:46:59.311846 24229 consensus_peers.cc:485] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb -> Peer ae2644a0309046aea365398895c9ece6 (127.9.82.131:43909): Couldn't send request to peer ae2644a0309046aea365398895c9ece6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f08d1f3e8e345c1a5245e8bbebab524. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:59.312000 25330 consensus_queue.cc:1035] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:59.313666 25327 raft_consensus.cc:2932] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER ae2644a0309046aea365398895c9ece6 (127.9.82.131) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } } }
I20240502 20:46:59.314992 24692 raft_consensus.cc:2932] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER ae2644a0309046aea365398895c9ece6 (127.9.82.131) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } } }
I20240502 20:46:59.316013 24154 catalog_manager.cc:5484] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb reported cstate change: config changed from index -1 to 4, NON_VOTER ae2644a0309046aea365398895c9ece6 (127.9.82.131) added. New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:59.323895 24692 consensus_queue.cc:237] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } }
I20240502 20:46:59.325578 24294 raft_consensus.cc:1261] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:59.326072 25313 consensus_queue.cc:1035] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:59.328518 24912 raft_consensus.cc:2932] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER ae2644a0309046aea365398895c9ece6 (127.9.82.131) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } } }
W20240502 20:46:59.328655 24625 consensus_peers.cc:485] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 -> Peer ae2644a0309046aea365398895c9ece6 (127.9.82.131:43909): Couldn't send request to peer ae2644a0309046aea365398895c9ece6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a40bf08f27274741907ea48e193077a2. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:59.329126 24294 raft_consensus.cc:2932] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER ae2644a0309046aea365398895c9ece6 (127.9.82.131) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } } }
I20240502 20:46:59.331184 24145 catalog_manager.cc:5484] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index -1 to 4, NON_VOTER ae2644a0309046aea365398895c9ece6 (127.9.82.131) added. New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:59.339745 24294 consensus_queue.cc:237] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } }
I20240502 20:46:59.341213 24692 raft_consensus.cc:1261] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:46:59.341751 25327 consensus_queue.cc:1035] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:46:59.343855 24759 raft_consensus.cc:2932] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } } }
I20240502 20:46:59.344310 24692 raft_consensus.cc:2932] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } } }
W20240502 20:46:59.345011 24229 consensus_peers.cc:485] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb -> Peer 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130:46361): Couldn't send request to peer 7a28c3fffd6a4e52a614b015e61e9f82. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 159c7836166a4bca9bb919a1664c3942. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:46:59.346858 24145 catalog_manager.cc:5484] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb reported cstate change: config changed from index -1 to 4, NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) added. New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:46:59.534060 25041 heartbeater.cc:503] Master 127.9.82.190:39051 was elected leader, sending a full tablet report...
I20240502 20:46:59.652793 25418 ts_tablet_manager.cc:902] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: Initiating tablet copy from peer 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:59.653656 25418 tablet_copy_client.cc:308] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:34815
I20240502 20:46:59.657934 24712 tablet_copy_service.cc:140] P 1a7e96b0f12a433e81bd6c063c070d63: Received BeginTabletCopySession request for tablet edac54600a5b47aab10e615dc7c68a6a from peer 7a28c3fffd6a4e52a614b015e61e9f82 ({username='slave'} at 127.9.82.130:58121)
I20240502 20:46:59.658116 24712 tablet_copy_service.cc:161] P 1a7e96b0f12a433e81bd6c063c070d63: Beginning new tablet copy session on tablet edac54600a5b47aab10e615dc7c68a6a from peer 7a28c3fffd6a4e52a614b015e61e9f82 at {username='slave'} at 127.9.82.130:58121: session id = 7a28c3fffd6a4e52a614b015e61e9f82-edac54600a5b47aab10e615dc7c68a6a
I20240502 20:46:59.659888 24712 tablet_copy_source_session.cc:205] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:59.663777 25418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edac54600a5b47aab10e615dc7c68a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:59.670122 25418 tablet_copy_client.cc:783] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:59.670387 25418 tablet_copy_client.cc:647] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:59.672758 25418 tablet_copy_client.cc:523] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:59.674757 25418 tablet_bootstrap.cc:492] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: Bootstrap starting.
I20240502 20:46:59.681394 25418 log.cc:824] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:59.702530 25418 tablet_bootstrap.cc:492] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:59.702944 25418 tablet_bootstrap.cc:492] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: Bootstrap complete.
I20240502 20:46:59.703301 25418 ts_tablet_manager.cc:1367] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: Time spent bootstrapping tablet: real 0.029s user 0.018s sys 0.008s
I20240502 20:46:59.705451 25418 raft_consensus.cc:348] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } }
I20240502 20:46:59.705678 25418 raft_consensus.cc:729] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7a28c3fffd6a4e52a614b015e61e9f82, State: Initialized, Role: LEARNER
I20240502 20:46:59.706005 25418 consensus_queue.cc:260] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } }
I20240502 20:46:59.706916 25418 ts_tablet_manager.cc:1398] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20240502 20:46:59.708173 24712 tablet_copy_service.cc:342] P 1a7e96b0f12a433e81bd6c063c070d63: Request end of tablet copy session 7a28c3fffd6a4e52a614b015e61e9f82-edac54600a5b47aab10e615dc7c68a6a received from {username='slave'} at 127.9.82.130:58121
I20240502 20:46:59.708297 24712 tablet_copy_service.cc:433] P 1a7e96b0f12a433e81bd6c063c070d63: ending tablet copy session 7a28c3fffd6a4e52a614b015e61e9f82-edac54600a5b47aab10e615dc7c68a6a on tablet edac54600a5b47aab10e615dc7c68a6a with peer 7a28c3fffd6a4e52a614b015e61e9f82
I20240502 20:46:59.715456 25172 heartbeater.cc:503] Master 127.9.82.190:39051 was elected leader, sending a full tablet report...
I20240502 20:46:59.818874 25418 ts_tablet_manager.cc:902] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: Initiating tablet copy from peer f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:59.819411 25418 tablet_copy_client.cc:308] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:40657
I20240502 20:46:59.822872 24316 tablet_copy_service.cc:140] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Received BeginTabletCopySession request for tablet 159c7836166a4bca9bb919a1664c3942 from peer 7a28c3fffd6a4e52a614b015e61e9f82 ({username='slave'} at 127.9.82.130:55881)
I20240502 20:46:59.823027 24316 tablet_copy_service.cc:161] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Beginning new tablet copy session on tablet 159c7836166a4bca9bb919a1664c3942 from peer 7a28c3fffd6a4e52a614b015e61e9f82 at {username='slave'} at 127.9.82.130:55881: session id = 7a28c3fffd6a4e52a614b015e61e9f82-159c7836166a4bca9bb919a1664c3942
I20240502 20:46:59.824417 24316 tablet_copy_source_session.cc:205] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:59.825677 25418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 159c7836166a4bca9bb919a1664c3942. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:59.827508 25418 tablet_copy_client.cc:783] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:59.827669 25418 tablet_copy_client.cc:647] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:59.829509 25418 tablet_copy_client.cc:523] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:59.831038 25418 tablet_bootstrap.cc:492] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: Bootstrap starting.
I20240502 20:46:59.842725 25441 ts_tablet_manager.cc:902] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: Initiating tablet copy from peer 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:59.843502 25441 tablet_copy_client.cc:308] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:34815
I20240502 20:46:59.849014 24712 tablet_copy_service.cc:140] P 1a7e96b0f12a433e81bd6c063c070d63: Received BeginTabletCopySession request for tablet a40bf08f27274741907ea48e193077a2 from peer ae2644a0309046aea365398895c9ece6 ({username='slave'} at 127.9.82.131:41619)
I20240502 20:46:59.849155 24712 tablet_copy_service.cc:161] P 1a7e96b0f12a433e81bd6c063c070d63: Beginning new tablet copy session on tablet a40bf08f27274741907ea48e193077a2 from peer ae2644a0309046aea365398895c9ece6 at {username='slave'} at 127.9.82.131:41619: session id = ae2644a0309046aea365398895c9ece6-a40bf08f27274741907ea48e193077a2
I20240502 20:46:59.850024 24712 tablet_copy_source_session.cc:205] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:59.853793 25441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a40bf08f27274741907ea48e193077a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:59.857700 25418 tablet_bootstrap.cc:492] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:59.857988 25418 tablet_bootstrap.cc:492] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: Bootstrap complete.
I20240502 20:46:59.858187 25418 ts_tablet_manager.cc:1367] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: Time spent bootstrapping tablet: real 0.027s user 0.025s sys 0.000s
I20240502 20:46:59.858736 25418 raft_consensus.cc:348] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } }
I20240502 20:46:59.858847 25418 raft_consensus.cc:729] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7a28c3fffd6a4e52a614b015e61e9f82, State: Initialized, Role: LEARNER
I20240502 20:46:59.858955 25418 consensus_queue.cc:260] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } }
I20240502 20:46:59.859984 25418 ts_tablet_manager.cc:1398] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 20:46:59.860771 24316 tablet_copy_service.cc:342] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Request end of tablet copy session 7a28c3fffd6a4e52a614b015e61e9f82-159c7836166a4bca9bb919a1664c3942 received from {username='slave'} at 127.9.82.130:55881
I20240502 20:46:59.860819 25441 tablet_copy_client.cc:783] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:59.860885 24316 tablet_copy_service.cc:433] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: ending tablet copy session 7a28c3fffd6a4e52a614b015e61e9f82-159c7836166a4bca9bb919a1664c3942 on tablet 159c7836166a4bca9bb919a1664c3942 with peer 7a28c3fffd6a4e52a614b015e61e9f82
I20240502 20:46:59.861028 25441 tablet_copy_client.cc:647] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:59.862869 25441 tablet_copy_client.cc:523] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:59.864984 25441 tablet_bootstrap.cc:492] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: Bootstrap starting.
I20240502 20:46:59.872253 25441 log.cc:824] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: Log is configured to *not* fsync() on all Append() calls
I20240502 20:46:59.885566 25418 ts_tablet_manager.cc:902] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: Initiating tablet copy from peer 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815)
I20240502 20:46:59.886098 25418 tablet_copy_client.cc:308] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:34815
I20240502 20:46:59.886678 24712 tablet_copy_service.cc:140] P 1a7e96b0f12a433e81bd6c063c070d63: Received BeginTabletCopySession request for tablet e390db409933416699186d01bc5dce7f from peer 7a28c3fffd6a4e52a614b015e61e9f82 ({username='slave'} at 127.9.82.130:58121)
I20240502 20:46:59.886809 24712 tablet_copy_service.cc:161] P 1a7e96b0f12a433e81bd6c063c070d63: Beginning new tablet copy session on tablet e390db409933416699186d01bc5dce7f from peer 7a28c3fffd6a4e52a614b015e61e9f82 at {username='slave'} at 127.9.82.130:58121: session id = 7a28c3fffd6a4e52a614b015e61e9f82-e390db409933416699186d01bc5dce7f
I20240502 20:46:59.887773 24712 tablet_copy_source_session.cc:205] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:59.888696 25418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e390db409933416699186d01bc5dce7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:59.891008 25418 tablet_copy_client.cc:783] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:59.891172 25418 tablet_copy_client.cc:647] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:59.892536 25418 tablet_copy_client.cc:523] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:59.894109 25418 tablet_bootstrap.cc:492] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: Bootstrap starting.
I20240502 20:46:59.896637 25441 tablet_bootstrap.cc:492] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:59.897078 25441 tablet_bootstrap.cc:492] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: Bootstrap complete.
I20240502 20:46:59.897473 25441 ts_tablet_manager.cc:1367] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.009s
I20240502 20:46:59.897943 25473 ts_tablet_manager.cc:902] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: Initiating tablet copy from peer f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:59.898495 25473 tablet_copy_client.cc:308] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:40657
I20240502 20:46:59.900475 25441 raft_consensus.cc:348] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } }
I20240502 20:46:59.900753 25441 raft_consensus.cc:729] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ae2644a0309046aea365398895c9ece6, State: Initialized, Role: LEARNER
I20240502 20:46:59.901135 25441 consensus_queue.cc:260] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } }
I20240502 20:46:59.902076 25441 ts_tablet_manager.cc:1398] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 20:46:59.902662 24316 tablet_copy_service.cc:140] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Received BeginTabletCopySession request for tablet f013826a7f06472b9704b16a26885074 from peer ae2644a0309046aea365398895c9ece6 ({username='slave'} at 127.9.82.131:49885)
I20240502 20:46:59.902783 24316 tablet_copy_service.cc:161] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Beginning new tablet copy session on tablet f013826a7f06472b9704b16a26885074 from peer ae2644a0309046aea365398895c9ece6 at {username='slave'} at 127.9.82.131:49885: session id = ae2644a0309046aea365398895c9ece6-f013826a7f06472b9704b16a26885074
I20240502 20:46:59.902802 24712 tablet_copy_service.cc:342] P 1a7e96b0f12a433e81bd6c063c070d63: Request end of tablet copy session ae2644a0309046aea365398895c9ece6-a40bf08f27274741907ea48e193077a2 received from {username='slave'} at 127.9.82.131:41619
I20240502 20:46:59.902907 24712 tablet_copy_service.cc:433] P 1a7e96b0f12a433e81bd6c063c070d63: ending tablet copy session ae2644a0309046aea365398895c9ece6-a40bf08f27274741907ea48e193077a2 on tablet a40bf08f27274741907ea48e193077a2 with peer ae2644a0309046aea365398895c9ece6
I20240502 20:46:59.903647 24316 tablet_copy_source_session.cc:205] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:59.904690 25441 ts_tablet_manager.cc:902] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: Initiating tablet copy from peer f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657)
I20240502 20:46:59.905030 25473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f013826a7f06472b9704b16a26885074. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:59.905107 25441 tablet_copy_client.cc:308] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:40657
I20240502 20:46:59.905606 24316 tablet_copy_service.cc:140] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Received BeginTabletCopySession request for tablet 4f08d1f3e8e345c1a5245e8bbebab524 from peer ae2644a0309046aea365398895c9ece6 ({username='slave'} at 127.9.82.131:49885)
I20240502 20:46:59.905723 24316 tablet_copy_service.cc:161] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Beginning new tablet copy session on tablet 4f08d1f3e8e345c1a5245e8bbebab524 from peer ae2644a0309046aea365398895c9ece6 at {username='slave'} at 127.9.82.131:49885: session id = ae2644a0309046aea365398895c9ece6-4f08d1f3e8e345c1a5245e8bbebab524
I20240502 20:46:59.906628 24316 tablet_copy_source_session.cc:205] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:46:59.907477 25441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f08d1f3e8e345c1a5245e8bbebab524. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:46:59.907509 25473 tablet_copy_client.cc:783] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:59.907707 25473 tablet_copy_client.cc:647] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:59.908869 25473 tablet_copy_client.cc:523] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:59.909600 25441 tablet_copy_client.cc:783] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: tablet copy: Starting download of 0 data blocks...
I20240502 20:46:59.909754 25441 tablet_copy_client.cc:647] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: tablet copy: Starting download of 1 WAL segments...
I20240502 20:46:59.910109 25473 tablet_bootstrap.cc:492] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: Bootstrap starting.
I20240502 20:46:59.911370 25441 tablet_copy_client.cc:523] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:46:59.912655 25441 tablet_bootstrap.cc:492] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: Bootstrap starting.
I20240502 20:46:59.924304 25418 tablet_bootstrap.cc:492] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:59.924645 25418 tablet_bootstrap.cc:492] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: Bootstrap complete.
I20240502 20:46:59.924845 25418 ts_tablet_manager.cc:1367] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: Time spent bootstrapping tablet: real 0.031s user 0.026s sys 0.000s
I20240502 20:46:59.925355 25418 raft_consensus.cc:348] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } }
I20240502 20:46:59.925498 25418 raft_consensus.cc:729] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7a28c3fffd6a4e52a614b015e61e9f82, State: Initialized, Role: LEARNER
I20240502 20:46:59.925604 25418 consensus_queue.cc:260] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: true } }
I20240502 20:46:59.925915 25418 ts_tablet_manager.cc:1398] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:46:59.926560 24712 tablet_copy_service.cc:342] P 1a7e96b0f12a433e81bd6c063c070d63: Request end of tablet copy session 7a28c3fffd6a4e52a614b015e61e9f82-e390db409933416699186d01bc5dce7f received from {username='slave'} at 127.9.82.130:58121
I20240502 20:46:59.926661 24712 tablet_copy_service.cc:433] P 1a7e96b0f12a433e81bd6c063c070d63: ending tablet copy session 7a28c3fffd6a4e52a614b015e61e9f82-e390db409933416699186d01bc5dce7f on tablet e390db409933416699186d01bc5dce7f with peer 7a28c3fffd6a4e52a614b015e61e9f82
I20240502 20:46:59.930380 25473 tablet_bootstrap.cc:492] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:59.930678 25473 tablet_bootstrap.cc:492] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: Bootstrap complete.
I20240502 20:46:59.930858 25473 ts_tablet_manager.cc:1367] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.007s
I20240502 20:46:59.931362 25473 raft_consensus.cc:348] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } }
I20240502 20:46:59.931473 25473 raft_consensus.cc:729] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ae2644a0309046aea365398895c9ece6, State: Initialized, Role: LEARNER
I20240502 20:46:59.931581 25473 consensus_queue.cc:260] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } }
I20240502 20:46:59.931882 25473 ts_tablet_manager.cc:1398] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:46:59.932603 24316 tablet_copy_service.cc:342] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Request end of tablet copy session ae2644a0309046aea365398895c9ece6-f013826a7f06472b9704b16a26885074 received from {username='slave'} at 127.9.82.131:49885
I20240502 20:46:59.932704 24316 tablet_copy_service.cc:433] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: ending tablet copy session ae2644a0309046aea365398895c9ece6-f013826a7f06472b9704b16a26885074 on tablet f013826a7f06472b9704b16a26885074 with peer ae2644a0309046aea365398895c9ece6
I20240502 20:46:59.936094 25441 tablet_bootstrap.cc:492] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:46:59.936345 25441 tablet_bootstrap.cc:492] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: Bootstrap complete.
I20240502 20:46:59.936488 25441 ts_tablet_manager.cc:1367] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: Time spent bootstrapping tablet: real 0.024s user 0.024s sys 0.000s
I20240502 20:46:59.936842 25441 raft_consensus.cc:348] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } }
I20240502 20:46:59.936942 25441 raft_consensus.cc:729] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ae2644a0309046aea365398895c9ece6, State: Initialized, Role: LEARNER
I20240502 20:46:59.937011 25441 consensus_queue.cc:260] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: true } }
I20240502 20:46:59.937260 25441 ts_tablet_manager.cc:1398] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:46:59.937880 24316 tablet_copy_service.cc:342] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Request end of tablet copy session ae2644a0309046aea365398895c9ece6-4f08d1f3e8e345c1a5245e8bbebab524 received from {username='slave'} at 127.9.82.131:49885
I20240502 20:46:59.937968 24316 tablet_copy_service.cc:433] P f8a2e74ce1ca4012b0ebe4ca080ba3fb: ending tablet copy session ae2644a0309046aea365398895c9ece6-4f08d1f3e8e345c1a5245e8bbebab524 on tablet 4f08d1f3e8e345c1a5245e8bbebab524 with peer ae2644a0309046aea365398895c9ece6
I20240502 20:47:00.173954 24995 raft_consensus.cc:1203] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:47:00.222949 25126 raft_consensus.cc:1203] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:47:00.281893 25126 raft_consensus.cc:1203] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:47:00.404521 24995 raft_consensus.cc:1203] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:47:00.428946 24995 raft_consensus.cc:1203] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:47:00.521453 25126 raft_consensus.cc:1203] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 20:47:00.647773 25516 raft_consensus.cc:1050] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63: attempting to promote NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 to VOTER
I20240502 20:47:00.648293 25516 consensus_queue.cc:237] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } }
I20240502 20:47:00.649749 24294 raft_consensus.cc:1261] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:00.649812 24995 raft_consensus.cc:1261] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:00.650242 24912 consensus_queue.cc:1035] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:00.650440 25517 consensus_queue.cc:1035] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:00.652536 25517 raft_consensus.cc:2932] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:00.653010 24294 raft_consensus.cc:2932] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:00.653916 24995 raft_consensus.cc:2932] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:00.655766 24154 catalog_manager.cc:5484] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:00.659214 24692 consensus_queue.cc:237] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } }
I20240502 20:47:00.660331 24995 raft_consensus.cc:1261] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:00.660805 24912 consensus_queue.cc:1035] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:00.662474 25516 raft_consensus.cc:2932] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:00.662940 24995 raft_consensus.cc:2932] T edac54600a5b47aab10e615dc7c68a6a P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:00.663975 24139 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet edac54600a5b47aab10e615dc7c68a6a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:00.665135 24152 catalog_manager.cc:5484] T edac54600a5b47aab10e615dc7c68a6a P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index 5 to 6, VOTER f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:00.667819 24275 tablet_service.cc:1514] Processing DeleteTablet for tablet edac54600a5b47aab10e615dc7c68a6a with delete_type TABLET_DATA_TOMBSTONED (TS f8a2e74ce1ca4012b0ebe4ca080ba3fb not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58462
I20240502 20:47:00.668390 25587 tablet_replica.cc:330] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb: stopping tablet replica
I20240502 20:47:00.668738 25587 raft_consensus.cc:2229] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:00.669045 25587 raft_consensus.cc:2258] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:00.670234 25587 ts_tablet_manager.cc:1875] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:00.672300 25587 ts_tablet_manager.cc:1888] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:47:00.672394 25587 log.cc:1196] T edac54600a5b47aab10e615dc7c68a6a P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/edac54600a5b47aab10e615dc7c68a6a
I20240502 20:47:00.673096 24138 catalog_manager.cc:4830] TS f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657): tablet edac54600a5b47aab10e615dc7c68a6a (table rebalance_test_table_2 [id=be64d8d4ee104e5f924e60f9df0251a4]) successfully deleted
I20240502 20:47:00.763995 25516 raft_consensus.cc:1050] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63: attempting to promote NON_VOTER ae2644a0309046aea365398895c9ece6 to VOTER
I20240502 20:47:00.764407 25516 consensus_queue.cc:237] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } }
I20240502 20:47:00.765810 24294 raft_consensus.cc:1261] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:00.765906 25126 raft_consensus.cc:1261] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:00.766332 25516 consensus_queue.cc:1035] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:00.766557 24912 consensus_queue.cc:1035] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:00.768553 25516 raft_consensus.cc:2932] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.769053 24294 raft_consensus.cc:2932] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.771024 25126 raft_consensus.cc:2932] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.771389 24152 catalog_manager.cc:5484] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:00.776185 24692 consensus_queue.cc:237] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } }
I20240502 20:47:00.777146 25126 raft_consensus.cc:1261] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6 [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:00.777576 25517 consensus_queue.cc:1035] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:00.779366 25516 raft_consensus.cc:2932] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.779840 25126 raft_consensus.cc:2932] T a40bf08f27274741907ea48e193077a2 P ae2644a0309046aea365398895c9ece6 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.780726 24139 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a40bf08f27274741907ea48e193077a2 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:00.781740 24154 catalog_manager.cc:5484] T a40bf08f27274741907ea48e193077a2 P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index 5 to 6, VOTER f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:00.784317 24275 tablet_service.cc:1514] Processing DeleteTablet for tablet a40bf08f27274741907ea48e193077a2 with delete_type TABLET_DATA_TOMBSTONED (TS f8a2e74ce1ca4012b0ebe4ca080ba3fb not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58462
I20240502 20:47:00.784585 25587 tablet_replica.cc:330] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: stopping tablet replica
I20240502 20:47:00.784732 25587 raft_consensus.cc:2229] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:00.784899 25587 raft_consensus.cc:2258] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:00.785672 25587 ts_tablet_manager.cc:1875] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:00.787500 25587 ts_tablet_manager.cc:1888] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:47:00.787580 25587 log.cc:1196] T a40bf08f27274741907ea48e193077a2 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/a40bf08f27274741907ea48e193077a2
I20240502 20:47:00.788159 24138 catalog_manager.cc:4830] TS f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657): tablet a40bf08f27274741907ea48e193077a2 (table rebalance_test_table_0 [id=5b0fc51dc8c64b1e895b88948866803f]) successfully deleted
I20240502 20:47:00.820405 25518 raft_consensus.cc:1050] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: attempting to promote NON_VOTER ae2644a0309046aea365398895c9ece6 to VOTER
I20240502 20:47:00.821007 25518 consensus_queue.cc:237] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } }
I20240502 20:47:00.822362 25126 raft_consensus.cc:1261] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:00.822362 24692 raft_consensus.cc:1261] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:00.822789 24759 consensus_queue.cc:1035] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:00.822968 25518 consensus_queue.cc:1035] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:00.824930 25549 raft_consensus.cc:2932] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.825388 24692 raft_consensus.cc:2932] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.827526 25126 raft_consensus.cc:2932] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.827991 24145 catalog_manager.cc:5484] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.832115 24294 consensus_queue.cc:237] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } }
I20240502 20:47:00.833232 25126 raft_consensus.cc:1261] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:00.833652 25549 consensus_queue.cc:1035] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:00.835204 24759 raft_consensus.cc:2932] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.836759 24138 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f013826a7f06472b9704b16a26885074 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:00.837287 25126 raft_consensus.cc:2932] T f013826a7f06472b9704b16a26885074 P ae2644a0309046aea365398895c9ece6 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:00.837697 24152 catalog_manager.cc:5484] T f013826a7f06472b9704b16a26885074 P f8a2e74ce1ca4012b0ebe4ca080ba3fb reported cstate change: config changed from index 5 to 6, VOTER 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:00.840868 24672 tablet_service.cc:1514] Processing DeleteTablet for tablet f013826a7f06472b9704b16a26885074 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7e96b0f12a433e81bd6c063c070d63 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37126
I20240502 20:47:00.841395 25629 tablet_replica.cc:330] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63: stopping tablet replica
I20240502 20:47:00.841725 25629 raft_consensus.cc:2229] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:00.841938 25629 raft_consensus.cc:2258] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:00.843506 25629 ts_tablet_manager.cc:1875] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:00.845831 25629 ts_tablet_manager.cc:1888] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:47:00.845928 25629 log.cc:1196] T f013826a7f06472b9704b16a26885074 P 1a7e96b0f12a433e81bd6c063c070d63: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/f013826a7f06472b9704b16a26885074
I20240502 20:47:00.846527 24139 catalog_manager.cc:4830] TS 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815): tablet f013826a7f06472b9704b16a26885074 (table rebalance_test_table_1 [id=84d42226de37466886abeca49c1d5c03]) successfully deleted
I20240502 20:47:00.998795 24912 raft_consensus.cc:1050] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63: attempting to promote NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 to VOTER
I20240502 20:47:00.999217 24912 consensus_queue.cc:237] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } }
I20240502 20:47:01.000614 24995 raft_consensus.cc:1261] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:01.000658 24294 raft_consensus.cc:1261] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:01.001080 25517 consensus_queue.cc:1035] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:01.001291 25516 consensus_queue.cc:1035] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:01.004014 24912 raft_consensus.cc:2932] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.004496 24294 raft_consensus.cc:2932] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.006137 24995 raft_consensus.cc:2932] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.007054 24154 catalog_manager.cc:5484] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:01.010185 24692 consensus_queue.cc:237] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } }
I20240502 20:47:01.011269 24995 raft_consensus.cc:1261] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 FOLLOWER]: Refusing update from remote peer 1a7e96b0f12a433e81bd6c063c070d63: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:01.011662 24912 consensus_queue.cc:1035] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:01.013271 25516 raft_consensus.cc:2932] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.013701 24995 raft_consensus.cc:2932] T e390db409933416699186d01bc5dce7f P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.014606 24139 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e390db409933416699186d01bc5dce7f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:01.015945 24152 catalog_manager.cc:5484] T e390db409933416699186d01bc5dce7f P 1a7e96b0f12a433e81bd6c063c070d63 reported cstate change: config changed from index 5 to 6, VOTER f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "1a7e96b0f12a433e81bd6c063c070d63" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:01.017930 24759 raft_consensus.cc:1050] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: attempting to promote NON_VOTER 7a28c3fffd6a4e52a614b015e61e9f82 to VOTER
I20240502 20:47:01.018348 24759 consensus_queue.cc:237] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } }
I20240502 20:47:01.018771 24275 tablet_service.cc:1514] Processing DeleteTablet for tablet e390db409933416699186d01bc5dce7f with delete_type TABLET_DATA_TOMBSTONED (TS f8a2e74ce1ca4012b0ebe4ca080ba3fb not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58462
I20240502 20:47:01.018997 25587 tablet_replica.cc:330] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb: stopping tablet replica
I20240502 20:47:01.019160 25587 raft_consensus.cc:2229] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:01.019315 25587 raft_consensus.cc:2258] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:01.019668 24692 raft_consensus.cc:1261] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:01.019966 25587 ts_tablet_manager.cc:1875] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:01.020071 24995 raft_consensus.cc:1261] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 LEARNER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:01.020159 25549 consensus_queue.cc:1035] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:01.020413 25518 consensus_queue.cc:1035] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:01.022001 25587 ts_tablet_manager.cc:1888] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:47:01.022071 25587 log.cc:1196] T e390db409933416699186d01bc5dce7f P f8a2e74ce1ca4012b0ebe4ca080ba3fb: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/e390db409933416699186d01bc5dce7f
I20240502 20:47:01.022146 25549 raft_consensus.cc:2932] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.022626 24138 catalog_manager.cc:4830] TS f8a2e74ce1ca4012b0ebe4ca080ba3fb (127.9.82.129:40657): tablet e390db409933416699186d01bc5dce7f (table rebalance_test_table_1 [id=84d42226de37466886abeca49c1d5c03]) successfully deleted
I20240502 20:47:01.022714 24995 raft_consensus.cc:2932] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.024477 24692 raft_consensus.cc:2932] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.024648 24145 catalog_manager.cc:5484] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb reported cstate change: config changed from index 4 to 5, 7a28c3fffd6a4e52a614b015e61e9f82 (127.9.82.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:01.027520 24294 consensus_queue.cc:237] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } }
I20240502 20:47:01.028602 24995 raft_consensus.cc:1261] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:01.029006 24759 consensus_queue.cc:1035] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:01.030493 25518 raft_consensus.cc:2932] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.030977 24995 raft_consensus.cc:2932] T 159c7836166a4bca9bb919a1664c3942 P 7a28c3fffd6a4e52a614b015e61e9f82 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } } }
I20240502 20:47:01.031916 24138 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 159c7836166a4bca9bb919a1664c3942 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:01.032621 24152 catalog_manager.cc:5484] T 159c7836166a4bca9bb919a1664c3942 P f8a2e74ce1ca4012b0ebe4ca080ba3fb reported cstate change: config changed from index 5 to 6, VOTER 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a28c3fffd6a4e52a614b015e61e9f82" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 46361 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:01.034950 24672 tablet_service.cc:1514] Processing DeleteTablet for tablet 159c7836166a4bca9bb919a1664c3942 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7e96b0f12a433e81bd6c063c070d63 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37126
I20240502 20:47:01.035197 25629 tablet_replica.cc:330] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: stopping tablet replica
I20240502 20:47:01.035362 25629 raft_consensus.cc:2229] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:01.035506 25629 raft_consensus.cc:2258] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:01.036227 25629 ts_tablet_manager.cc:1875] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:01.037926 25629 ts_tablet_manager.cc:1888] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:47:01.037994 25629 log.cc:1196] T 159c7836166a4bca9bb919a1664c3942 P 1a7e96b0f12a433e81bd6c063c070d63: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/159c7836166a4bca9bb919a1664c3942
I20240502 20:47:01.038497 24139 catalog_manager.cc:4830] TS 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815): tablet 159c7836166a4bca9bb919a1664c3942 (table rebalance_test_table_0 [id=5b0fc51dc8c64b1e895b88948866803f]) successfully deleted
I20240502 20:47:01.047334 25518 raft_consensus.cc:1050] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb: attempting to promote NON_VOTER ae2644a0309046aea365398895c9ece6 to VOTER
I20240502 20:47:01.047699 25518 consensus_queue.cc:237] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } }
I20240502 20:47:01.049067 25126 raft_consensus.cc:1261] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6 [term 1 LEARNER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:01.049065 24692 raft_consensus.cc:1261] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:01.049537 25549 consensus_queue.cc:1035] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:01.049758 25518 consensus_queue.cc:1035] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:01.051611 25549 raft_consensus.cc:2932] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:01.053033 25126 raft_consensus.cc:2932] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:01.055305 24692 raft_consensus.cc:2932] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:01.055968 24154 catalog_manager.cc:5484] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb reported cstate change: config changed from index 4 to 5, ae2644a0309046aea365398895c9ece6 (127.9.82.131) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7e96b0f12a433e81bd6c063c070d63" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 34815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:01.059139 24294 consensus_queue.cc:237] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } }
I20240502 20:47:01.060070 25126 raft_consensus.cc:1261] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6 [term 1 FOLLOWER]: Refusing update from remote peer f8a2e74ce1ca4012b0ebe4ca080ba3fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:01.060413 25549 consensus_queue.cc:1035] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:01.061796 24759 raft_consensus.cc:2932] T 4f08d1f3e8e345c1a5245e8bbebab524 P f8a2e74ce1ca4012b0ebe4ca080ba3fb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:01.062296 25126 raft_consensus.cc:2932] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:01.063839 24138 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 4f08d1f3e8e345c1a5245e8bbebab524 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:01.064332 24145 catalog_manager.cc:5484] T 4f08d1f3e8e345c1a5245e8bbebab524 P ae2644a0309046aea365398895c9ece6 reported cstate change: config changed from index 5 to 6, VOTER 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f8a2e74ce1ca4012b0ebe4ca080ba3fb" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 40657 } } peers { permanent_uuid: "ae2644a0309046aea365398895c9ece6" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 43909 } attrs { promote: false } } }
I20240502 20:47:01.066784 24672 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f08d1f3e8e345c1a5245e8bbebab524 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7e96b0f12a433e81bd6c063c070d63 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37126
I20240502 20:47:01.067006 25629 tablet_replica.cc:330] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63: stopping tablet replica
I20240502 20:47:01.067122 25629 raft_consensus.cc:2229] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:01.067234 25629 raft_consensus.cc:2258] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:01.067884 25629 ts_tablet_manager.cc:1875] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:01.069607 25629 ts_tablet_manager.cc:1888] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 20:47:01.069675 25629 log.cc:1196] T 4f08d1f3e8e345c1a5245e8bbebab524 P 1a7e96b0f12a433e81bd6c063c070d63: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/4f08d1f3e8e345c1a5245e8bbebab524
I20240502 20:47:01.070220 24139 catalog_manager.cc:4830] TS 1a7e96b0f12a433e81bd6c063c070d63 (127.9.82.132:34815): tablet 4f08d1f3e8e345c1a5245e8bbebab524 (table rebalance_test_table_2 [id=be64d8d4ee104e5f924e60f9df0251a4]) successfully deleted
I20240502 20:47:01.158895 24672 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:47:01.159171 24275 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:01.159979 24975 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:01.163393 25105 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:01.256305 24672 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:47:01.258145 24975 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:01.258352 25105 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:01.267814 24275 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:01.341156 24975 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:01.341451 24672 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 20:47:01.344067 25105 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:01.344329 24275 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:01.380548 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 24214
I20240502 20:47:01.388185 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 24913
I20240502 20:47:01.394755 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 25044
I20240502 20:47:01.401196 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 24609
I20240502 20:47:01.408047 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 24123
2024-05-02T20:47:01Z chronyd exiting
[ OK ] LocationAwareRebalancingParamTest.Rebalance/idx7_rf2_t3_l_1_2_1 (9632 ms)
[ RUN ] LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer/idx6_rf7_t7_l_3_4_3
I20240502 20:47:01.435238 9546 test_util.cc:268] Using random seed: -1267114144
I20240502 20:47:01.436115 9546 ts_itest-base.cc:112] Starting cluster with:
I20240502 20:47:01.436161 9546 ts_itest-base.cc:113] --------------
I20240502 20:47:01.436172 9546 ts_itest-base.cc:114] 10 tablet servers
I20240502 20:47:01.436182 9546 ts_itest-base.cc:115] 7 replicas per TS
I20240502 20:47:01.436192 9546 ts_itest-base.cc:116] --------------
2024-05-02T20:47:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T20:47:01Z Disabled control of system clock
I20240502 20:47:01.445504 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:37939
--webserver_interface=127.9.82.190
--webserver_port=0
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.82.190:37939
--location_mapping_cmd=/tmp/dist-test-taskIC8fEc/build/debug/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/location-assignment.state --map /A:3 --map /B:4 --map /C:3
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false
--master_client_location_assignment_enabled=false
--allow_unsafe_replication_factor with env {}
W20240502 20:47:01.556143 25792 flags.cc:425] Enabled unsafe flag: --allow_unsafe_replication_factor=true
W20240502 20:47:01.556445 25792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:01.556509 25792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:01.556584 25792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:01.559691 25792 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:01.559811 25792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 20:47:01.559861 25792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:01.559901 25792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 20:47:01.559938 25792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 20:47:01.563699 25792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
--allow_unsafe_replication_factor=true
--enable_range_replica_placement=false
--location_mapping_cmd=/tmp/dist-test-taskIC8fEc/build/debug/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/location-assignment.state --map /A:3 --map /B:4 --map /C:3
--ipki_ca_key_size=768
--master_addresses=127.9.82.190:37939
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.82.190:37939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.9.82.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.25792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:01.564750 25792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:01.565927 25792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:01.573913 25800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:01.574292 25797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:01.575023 25798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:01.575654 25792 server_base.cc:1034] running on GCE node
I20240502 20:47:01.576241 25792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:01.577221 25792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:01.578389 25792 hybrid_clock.cc:648] HybridClock initialized: now 1714682821578378 us; error 30 us; skew 500 ppm
I20240502 20:47:01.580363 25792 webserver.cc:460] Webserver started at http://127.9.82.190:43135/ using document root <none> and password file <none>
I20240502 20:47:01.580920 25792 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:01.580981 25792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:01.581162 25792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:01.582805 25792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "23f153714b3b457c938b02b40ddaa9f9"
format_stamp: "Formatted at 2024-05-02 20:47:01 on dist-test-slave-2pss"
I20240502 20:47:01.583282 25792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "23f153714b3b457c938b02b40ddaa9f9"
format_stamp: "Formatted at 2024-05-02 20:47:01 on dist-test-slave-2pss"
I20240502 20:47:01.586920 25792 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20240502 20:47:01.589460 25806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:01.590504 25792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:01.590641 25792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
uuid: "23f153714b3b457c938b02b40ddaa9f9"
format_stamp: "Formatted at 2024-05-02 20:47:01 on dist-test-slave-2pss"
I20240502 20:47:01.590735 25792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:01.617815 25792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:01.618538 25792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:01.618721 25792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:01.625826 25792 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.190:37939
I20240502 20:47:01.625890 25858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.190:37939 every 8 connection(s)
I20240502 20:47:01.626858 25792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 20:47:01.629628 25859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:01.632057 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 25792
I20240502 20:47:01.632208 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 20:47:01.635473 25859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9: Bootstrap starting.
I20240502 20:47:01.637802 25859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:01.638569 25859 log.cc:824] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:01.640604 25859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9: No bootstrap required, opened a new log
I20240502 20:47:01.643424 25859 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23f153714b3b457c938b02b40ddaa9f9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 37939 } }
I20240502 20:47:01.643615 25859 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:01.643657 25859 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f153714b3b457c938b02b40ddaa9f9, State: Initialized, Role: FOLLOWER
I20240502 20:47:01.644070 25859 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23f153714b3b457c938b02b40ddaa9f9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 37939 } }
I20240502 20:47:01.644201 25859 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 20:47:01.644248 25859 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 20:47:01.644338 25859 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:01.645280 25859 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23f153714b3b457c938b02b40ddaa9f9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 37939 } }
I20240502 20:47:01.645651 25859 leader_election.cc:302] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23f153714b3b457c938b02b40ddaa9f9; no voters:
I20240502 20:47:01.645961 25859 leader_election.cc:288] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 20:47:01.646083 25864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:01.646343 25864 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [term 1 LEADER]: Becoming Leader. State: Replica: 23f153714b3b457c938b02b40ddaa9f9, State: Running, Role: LEADER
I20240502 20:47:01.646653 25864 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23f153714b3b457c938b02b40ddaa9f9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 37939 } }
I20240502 20:47:01.647061 25859 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 20:47:01.648341 25866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23f153714b3b457c938b02b40ddaa9f9. Latest consensus state: current_term: 1 leader_uuid: "23f153714b3b457c938b02b40ddaa9f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23f153714b3b457c938b02b40ddaa9f9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 37939 } } }
I20240502 20:47:01.648350 25865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23f153714b3b457c938b02b40ddaa9f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23f153714b3b457c938b02b40ddaa9f9" member_type: VOTER last_known_addr { host: "127.9.82.190" port: 37939 } } }
I20240502 20:47:01.648591 25865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [sys.catalog]: This master's current role is: LEADER
I20240502 20:47:01.648527 25866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9 [sys.catalog]: This master's current role is: LEADER
I20240502 20:47:01.649363 25874 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 20:47:01.651995 25874 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 20:47:01.656934 25874 catalog_manager.cc:1347] Generated new cluster ID: bf79d5f045854525a40c39a965cb304f
I20240502 20:47:01.657012 25874 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 20:47:01.696627 25874 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 20:47:01.697949 25874 catalog_manager.cc:1504] Loading token signing keys...
I20240502 20:47:01.708026 25874 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 23f153714b3b457c938b02b40ddaa9f9: Generated new TSK 0
I20240502 20:47:01.708876 25874 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 20:47:01.725104 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.129:0
--local_ip_for_outbound_sockets=127.9.82.129
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:47:01.836148 25883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:01.836385 25883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:01.836429 25883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:01.839486 25883 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:01.839562 25883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:01.839637 25883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.129
I20240502 20:47:01.843367 25883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.9.82.129
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.25883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.129
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:01.844328 25883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:01.845466 25883 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:01.854190 25888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:01.854673 25891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:01.855381 25889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:01.855974 25883 server_base.cc:1034] running on GCE node
I20240502 20:47:01.856349 25883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:01.856914 25883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:01.858111 25883 hybrid_clock.cc:648] HybridClock initialized: now 1714682821858079 us; error 54 us; skew 500 ppm
I20240502 20:47:01.860178 25883 webserver.cc:460] Webserver started at http://127.9.82.129:37743/ using document root <none> and password file <none>
I20240502 20:47:01.860742 25883 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:01.860810 25883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:01.860996 25883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:01.862711 25883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
format_stamp: "Formatted at 2024-05-02 20:47:01 on dist-test-slave-2pss"
I20240502 20:47:01.863201 25883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
format_stamp: "Formatted at 2024-05-02 20:47:01 on dist-test-slave-2pss"
I20240502 20:47:01.866632 25883 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20240502 20:47:01.868918 25897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:01.870024 25883 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:01.870163 25883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
format_stamp: "Formatted at 2024-05-02 20:47:01 on dist-test-slave-2pss"
I20240502 20:47:01.870271 25883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:01.884011 25883 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:01.884660 25883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:01.884837 25883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:01.885396 25883 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:01.886307 25883 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:01.886359 25883 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:01.886416 25883 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:01.886451 25883 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:01.895349 25883 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.129:37129
I20240502 20:47:01.895382 26010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.129:37129 every 8 connection(s)
I20240502 20:47:01.896543 25883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 20:47:01.902072 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 25883
I20240502 20:47:01.902212 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 20:47:01.904662 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.130:0
--local_ip_for_outbound_sockets=127.9.82.130
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:01.906215 26011 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:01.906484 26011 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:01.907107 26011 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:01.958504 25823 ts_manager.cc:194] Registered new tserver with Master: 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129)
I20240502 20:47:01.960150 25823 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.129:58049
W20240502 20:47:02.033885 26014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:02.034135 26014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:02.034180 26014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:02.037357 26014 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:02.037432 26014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:02.037528 26014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.130
I20240502 20:47:02.041234 26014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.9.82.130
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.26014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.130
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:02.042171 26014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:02.043324 26014 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:02.051982 26021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.052402 26023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.053129 26020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:02.053820 26014 server_base.cc:1034] running on GCE node
I20240502 20:47:02.054221 26014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:02.054803 26014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:02.055958 26014 hybrid_clock.cc:648] HybridClock initialized: now 1714682822055898 us; error 77 us; skew 500 ppm
I20240502 20:47:02.058507 26014 webserver.cc:460] Webserver started at http://127.9.82.130:32941/ using document root <none> and password file <none>
I20240502 20:47:02.059150 26014 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:02.059216 26014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:02.059397 26014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:02.061174 26014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "73a41df730ef429d84fe648df03a2701"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.061655 26014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "73a41df730ef429d84fe648df03a2701"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.065304 26014 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 20:47:02.067713 26029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.068982 26014 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:47:02.069099 26014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "73a41df730ef429d84fe648df03a2701"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.069203 26014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:02.082144 26014 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:02.082854 26014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:02.083025 26014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:02.083621 26014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:02.084766 26014 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:02.084825 26014 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.084883 26014 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:02.084923 26014 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.094337 26014 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.130:34445
I20240502 20:47:02.094354 26142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.130:34445 every 8 connection(s)
I20240502 20:47:02.095396 26014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 20:47:02.102952 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 26014
I20240502 20:47:02.103091 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 20:47:02.105336 26143 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:02.105571 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.131:0
--local_ip_for_outbound_sockets=127.9.82.131
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:02.105618 26143 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:02.106308 26143 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:02.151666 25823 ts_manager.cc:194] Registered new tserver with Master: 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:02.152622 25823 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.130:46895
W20240502 20:47:02.228789 26146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:02.229035 26146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:02.229082 26146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:02.232185 26146 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:02.232262 26146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:02.232331 26146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.131
I20240502 20:47:02.236063 26146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.9.82.131
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.26146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.131
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:02.237033 26146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:02.238191 26146 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:02.247014 26155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.247485 26153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.248160 26152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:02.248844 26146 server_base.cc:1034] running on GCE node
I20240502 20:47:02.249310 26146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:02.249910 26146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:02.251091 26146 hybrid_clock.cc:648] HybridClock initialized: now 1714682822251080 us; error 33 us; skew 500 ppm
I20240502 20:47:02.258379 26146 webserver.cc:460] Webserver started at http://127.9.82.131:40619/ using document root <none> and password file <none>
I20240502 20:47:02.258989 26146 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:02.259057 26146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:02.259253 26146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:02.261045 26146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "6173ed1979b94e509bf1c843a5183690"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.261533 26146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "6173ed1979b94e509bf1c843a5183690"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.264962 26146 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 20:47:02.267326 26161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.268455 26146 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:02.268589 26146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "6173ed1979b94e509bf1c843a5183690"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.268682 26146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:02.304594 26146 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:02.305294 26146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:02.305470 26146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:02.306069 26146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:02.306990 26146 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:02.307050 26146 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.307111 26146 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:02.307144 26146 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.316659 26146 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.131:39463
I20240502 20:47:02.316684 26274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.131:39463 every 8 connection(s)
I20240502 20:47:02.317976 26146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 20:47:02.323836 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 26146
I20240502 20:47:02.323971 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 20:47:02.326635 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.132:0
--local_ip_for_outbound_sockets=127.9.82.132
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:02.327587 26275 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:02.327858 26275 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:02.328539 26275 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:02.368561 25823 ts_manager.cc:194] Registered new tserver with Master: 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:02.369367 25823 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.131:55993
W20240502 20:47:02.444416 26278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:02.444640 26278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:02.444684 26278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:02.448007 26278 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:02.448081 26278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:02.448175 26278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.132
I20240502 20:47:02.452172 26278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.132:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.9.82.132
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.26278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.132
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:02.453043 26278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:02.454174 26278 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:02.462730 26284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.463274 26287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.463701 26285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:02.464442 26278 server_base.cc:1034] running on GCE node
I20240502 20:47:02.464809 26278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:02.465355 26278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:02.466529 26278 hybrid_clock.cc:648] HybridClock initialized: now 1714682822466509 us; error 34 us; skew 500 ppm
I20240502 20:47:02.468760 26278 webserver.cc:460] Webserver started at http://127.9.82.132:41209/ using document root <none> and password file <none>
I20240502 20:47:02.469295 26278 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:02.469353 26278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:02.469506 26278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:02.471107 26278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.471529 26278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.474999 26278 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:02.477203 26293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.478267 26278 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:02.478370 26278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.478449 26278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:02.491601 26278 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:02.492285 26278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:02.492435 26278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:02.492950 26278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:02.493827 26278 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:02.493873 26278 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.493959 26278 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:02.493981 26278 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.502823 26278 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.132:43125
I20240502 20:47:02.502859 26406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.132:43125 every 8 connection(s)
I20240502 20:47:02.503835 26278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 20:47:02.504077 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 26278
I20240502 20:47:02.504211 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 20:47:02.506983 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.133:0
--local_ip_for_outbound_sockets=127.9.82.133
--webserver_interface=127.9.82.133
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:02.514546 26407 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:02.514828 26407 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:02.515460 26407 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:02.559338 25823 ts_manager.cc:194] Registered new tserver with Master: bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125)
I20240502 20:47:02.560180 25823 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.132:43905
W20240502 20:47:02.630775 26410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:02.631002 26410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:02.631048 26410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:02.634279 26410 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:02.634356 26410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:02.634433 26410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.133
I20240502 20:47:02.638276 26410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.133:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.9.82.133
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.26410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.133
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:02.639289 26410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:02.640549 26410 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:02.649775 26416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.650112 26419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.650780 26417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:02.651551 26410 server_base.cc:1034] running on GCE node
I20240502 20:47:02.652091 26410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:02.652684 26410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:02.653852 26410 hybrid_clock.cc:648] HybridClock initialized: now 1714682822653831 us; error 35 us; skew 500 ppm
I20240502 20:47:02.655966 26410 webserver.cc:460] Webserver started at http://127.9.82.133:39963/ using document root <none> and password file <none>
I20240502 20:47:02.656524 26410 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:02.656589 26410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:02.656746 26410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:02.658422 26410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "9aaa16c4fc46478f90a3d97b010330c2"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.658887 26410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "9aaa16c4fc46478f90a3d97b010330c2"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.662457 26410 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20240502 20:47:02.664811 26425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.665874 26410 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:47:02.665984 26410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "9aaa16c4fc46478f90a3d97b010330c2"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.666090 26410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:02.686158 26410 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:02.686848 26410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:02.687023 26410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:02.687620 26410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:02.688580 26410 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:02.688630 26410 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.688688 26410 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:02.688717 26410 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.697984 26410 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.133:37495
I20240502 20:47:02.698022 26538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.133:37495 every 8 connection(s)
I20240502 20:47:02.699025 26410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 20:47:02.704882 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 26410
I20240502 20:47:02.705009 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20240502 20:47:02.707559 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.134:0
--local_ip_for_outbound_sockets=127.9.82.134
--webserver_interface=127.9.82.134
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:02.708726 26539 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:02.708961 26539 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:02.709793 26539 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:02.748456 25823 ts_manager.cc:194] Registered new tserver with Master: 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:02.749248 25823 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.133:39519
W20240502 20:47:02.822363 26542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:02.822598 26542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:02.822671 26542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:02.825821 26542 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:02.825902 26542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:02.826011 26542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.134
I20240502 20:47:02.829731 26542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.134:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.9.82.134
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.26542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.134
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:02.830664 26542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:02.831811 26542 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:02.840305 26549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.840741 26548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:02.841454 26551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:02.842140 26542 server_base.cc:1034] running on GCE node
I20240502 20:47:02.842573 26542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:02.843158 26542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:02.844329 26542 hybrid_clock.cc:648] HybridClock initialized: now 1714682822844316 us; error 28 us; skew 500 ppm
I20240502 20:47:02.846329 26542 webserver.cc:460] Webserver started at http://127.9.82.134:44549/ using document root <none> and password file <none>
I20240502 20:47:02.846956 26542 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:02.847019 26542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:02.847213 26542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:02.849009 26542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.849503 26542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.852798 26542 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 20:47:02.855053 26557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.856192 26542 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:47:02.856292 26542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
format_stamp: "Formatted at 2024-05-02 20:47:02 on dist-test-slave-2pss"
I20240502 20:47:02.856393 26542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:02.873072 26542 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:02.873776 26542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:02.873970 26542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:02.874595 26542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:02.875517 26542 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:02.875566 26542 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.875610 26542 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:02.875640 26542 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:02.883924 26542 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.134:39815
I20240502 20:47:02.884076 26670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.134:39815 every 8 connection(s)
I20240502 20:47:02.884892 26542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20240502 20:47:02.885066 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 26542
I20240502 20:47:02.885192 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20240502 20:47:02.887758 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.135:0
--local_ip_for_outbound_sockets=127.9.82.135
--webserver_interface=127.9.82.135
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:02.894898 26671 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:02.895190 26671 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:02.895845 26671 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:02.943792 25823 ts_manager.cc:194] Registered new tserver with Master: 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:02.944548 25823 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.134:35819
I20240502 20:47:02.962827 26011 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
W20240502 20:47:03.017282 26674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:03.017516 26674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:03.017596 26674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:03.020715 26674 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:03.020799 26674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:03.020897 26674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.135
I20240502 20:47:03.024513 26674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.135:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.9.82.135
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.26674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.135
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:03.025435 26674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:03.026571 26674 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:03.034849 26681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:03.035245 26683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:03.035801 26680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:03.036618 26674 server_base.cc:1034] running on GCE node
I20240502 20:47:03.037042 26674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:03.037647 26674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:03.038825 26674 hybrid_clock.cc:648] HybridClock initialized: now 1714682823038812 us; error 32 us; skew 500 ppm
I20240502 20:47:03.040841 26674 webserver.cc:460] Webserver started at http://127.9.82.135:44703/ using document root <none> and password file <none>
I20240502 20:47:03.041422 26674 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:03.041486 26674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:03.041671 26674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:03.043318 26674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "b4908484400a4ce2aea341e9e1bdced3"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.043921 26674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "b4908484400a4ce2aea341e9e1bdced3"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.047377 26674 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:47:03.051978 26689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.053334 26674 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20240502 20:47:03.053455 26674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "b4908484400a4ce2aea341e9e1bdced3"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.053555 26674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:03.075239 26674 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:03.075950 26674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:03.076131 26674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:03.076709 26674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:03.077652 26674 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:03.077703 26674 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.077761 26674 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:03.077795 26674 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.086467 26674 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.135:39673
I20240502 20:47:03.086501 26802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.135:39673 every 8 connection(s)
I20240502 20:47:03.087457 26674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 20:47:03.095259 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 26674
I20240502 20:47:03.095412 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20240502 20:47:03.099050 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.136:0
--local_ip_for_outbound_sockets=127.9.82.136
--webserver_interface=127.9.82.136
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:03.107286 26803 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:03.107578 26803 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:03.108412 26803 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:03.155120 26143 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
I20240502 20:47:03.192982 25823 ts_manager.cc:194] Registered new tserver with Master: b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:03.194149 25823 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.135:48679
W20240502 20:47:03.230370 26806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:03.230626 26806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:03.230705 26806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:03.234092 26806 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:03.234331 26806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:03.234483 26806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.136
I20240502 20:47:03.238622 26806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.136:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.9.82.136
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.26806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.136
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:03.239828 26806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:03.241097 26806 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:03.250559 26813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:03.250931 26812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:03.251417 26815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:03.252223 26806 server_base.cc:1034] running on GCE node
I20240502 20:47:03.252712 26806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:03.253371 26806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:03.254547 26806 hybrid_clock.cc:648] HybridClock initialized: now 1714682823254526 us; error 48 us; skew 500 ppm
I20240502 20:47:03.256942 26806 webserver.cc:460] Webserver started at http://127.9.82.136:45641/ using document root <none> and password file <none>
I20240502 20:47:03.257562 26806 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:03.257622 26806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:03.257805 26806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:03.259557 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "706762b60f514a048c4935e359027441"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.260131 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "706762b60f514a048c4935e359027441"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.263516 26806 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:47:03.265817 26821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.266956 26806 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240502 20:47:03.267076 26806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "706762b60f514a048c4935e359027441"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.267163 26806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:03.283500 26806 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:03.284166 26806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:03.284329 26806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:03.284864 26806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:03.285892 26806 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:03.285954 26806 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.286017 26806 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:03.286051 26806 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.296758 26806 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.136:41039
I20240502 20:47:03.297101 26934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.136:41039 every 8 connection(s)
I20240502 20:47:03.297843 26806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 20:47:03.306921 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 26806
I20240502 20:47:03.307047 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20240502 20:47:03.307233 26935 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:03.307492 26935 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:03.308158 26935 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:03.309387 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.137:0
--local_ip_for_outbound_sockets=127.9.82.137
--webserver_interface=127.9.82.137
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:03.360637 25823 ts_manager.cc:194] Registered new tserver with Master: 706762b60f514a048c4935e359027441 (127.9.82.136:41039)
I20240502 20:47:03.361440 25823 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.136:49449
I20240502 20:47:03.371810 26275 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
W20240502 20:47:03.436511 26938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:03.436743 26938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:03.436790 26938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:03.439904 26938 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:03.439975 26938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:03.440091 26938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.137
I20240502 20:47:03.443838 26938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.137:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--webserver_interface=127.9.82.137
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.26938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.137
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:03.444799 26938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:03.445967 26938 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:03.454792 26944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:03.455183 26945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:03.455945 26947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:03.456681 26938 server_base.cc:1034] running on GCE node
I20240502 20:47:03.457125 26938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:03.457756 26938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:03.458957 26938 hybrid_clock.cc:648] HybridClock initialized: now 1714682823458945 us; error 28 us; skew 500 ppm
I20240502 20:47:03.461524 26938 webserver.cc:460] Webserver started at http://127.9.82.137:35593/ using document root <none> and password file <none>
I20240502 20:47:03.462241 26938 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:03.462323 26938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:03.462545 26938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:03.464773 26938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/instance:
uuid: "cc2b212930b84db1bb56f6952197955d"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.465368 26938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal/instance:
uuid: "cc2b212930b84db1bb56f6952197955d"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.469238 26938 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20240502 20:47:03.471612 26953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.472954 26938 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:03.473069 26938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
uuid: "cc2b212930b84db1bb56f6952197955d"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.473151 26938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:03.485065 26938 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:03.485688 26938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:03.485831 26938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:03.486339 26938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:03.487234 26938 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:03.487282 26938 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.487324 26938 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:03.487356 26938 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.495894 26938 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.137:35891
I20240502 20:47:03.495931 27066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.137:35891 every 8 connection(s)
I20240502 20:47:03.496898 26938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb
I20240502 20:47:03.506320 27067 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:03.506578 27067 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:03.506716 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 26938
I20240502 20:47:03.506827 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal/instance
I20240502 20:47:03.507174 27067 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:03.509377 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.138:0
--local_ip_for_outbound_sockets=127.9.82.138
--webserver_interface=127.9.82.138
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:03.543643 25822 ts_manager.cc:194] Registered new tserver with Master: cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891)
I20240502 20:47:03.544637 25822 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.137:35185
I20240502 20:47:03.562541 26407 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
W20240502 20:47:03.627971 27071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:03.628229 27071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:03.628285 27071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:03.632540 27071 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:03.632627 27071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:03.632723 27071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.138
I20240502 20:47:03.636718 27071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.138:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data/info.pb
--webserver_interface=127.9.82.138
--webserver_port=0
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.27071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.138
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:03.637636 27071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:03.639076 27071 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:03.649904 27079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:03.650301 27076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:03.650858 27077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:03.651664 27071 server_base.cc:1034] running on GCE node
I20240502 20:47:03.652308 27071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:03.653205 27071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:03.654414 27071 hybrid_clock.cc:648] HybridClock initialized: now 1714682823654389 us; error 47 us; skew 500 ppm
I20240502 20:47:03.657279 27071 webserver.cc:460] Webserver started at http://127.9.82.138:37413/ using document root <none> and password file <none>
I20240502 20:47:03.658046 27071 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:03.658143 27071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:03.658406 27071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 20:47:03.660573 27071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data/instance:
uuid: "21a5e6dc2695447798b4a87e7c6108db"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.661126 27071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal/instance:
uuid: "21a5e6dc2695447798b4a87e7c6108db"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.664686 27071 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20240502 20:47:03.667132 27085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.668385 27071 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 20:47:03.668510 27071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
uuid: "21a5e6dc2695447798b4a87e7c6108db"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:03.668622 27071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:03.690495 27071 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:03.691160 27071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:03.691339 27071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:03.691942 27071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:03.692843 27071 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:03.692891 27071 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.692930 27071 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:03.692946 27071 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:03.702204 27071 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.138:38195
I20240502 20:47:03.702236 27198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.138:38195 every 8 connection(s)
I20240502 20:47:03.703217 27071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data/info.pb
I20240502 20:47:03.710646 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 27071
I20240502 20:47:03.710780 9546 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal/instance
I20240502 20:47:03.712981 27199 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:03.713241 27199 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:03.713851 27199 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:03.750228 25822 ts_manager.cc:194] Registered new tserver with Master: 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195)
I20240502 20:47:03.750962 9546 external_mini_cluster.cc:930] 10 TS(s) registered with all masters
I20240502 20:47:03.751013 25822 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.138:46299
I20240502 20:47:03.751502 26539 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
I20240502 20:47:03.761780 9546 external_mini_cluster.cc:930] 10 TS(s) registered with all masters
I20240502 20:47:03.761873 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 26806
I20240502 20:47:03.768244 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 26938
I20240502 20:47:03.774108 9546 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu with pid 27071
I20240502 20:47:03.946843 26671 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
I20240502 20:47:04.197081 26803 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
I20240502 20:47:07.531445 25822 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52614:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:47:07.534833 25822 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_0 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 20:47:07.553215 25945 tablet_service.cc:1467] Processing CreateTablet for tablet f81a35dbe00342f89c4a42a3cfbbeacc (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.553212 26208 tablet_service.cc:1467] Processing CreateTablet for tablet bf4199a73df149368fb8d04f4c9723ef (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.554203 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81a35dbe00342f89c4a42a3cfbbeacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.554208 26208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4199a73df149368fb8d04f4c9723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.553215 26209 tablet_service.cc:1467] Processing CreateTablet for tablet f81a35dbe00342f89c4a42a3cfbbeacc (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.555364 26209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81a35dbe00342f89c4a42a3cfbbeacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.556064 25944 tablet_service.cc:1467] Processing CreateTablet for tablet bf4199a73df149368fb8d04f4c9723ef (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.556344 25944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4199a73df149368fb8d04f4c9723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.560325 26603 tablet_service.cc:1467] Processing CreateTablet for tablet e25072f604644d9595c95c1bd5bfd7db (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.561017 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25072f604644d9595c95c1bd5bfd7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.563769 26341 tablet_service.cc:1467] Processing CreateTablet for tablet f81a35dbe00342f89c4a42a3cfbbeacc (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.560021 26605 tablet_service.cc:1467] Processing CreateTablet for tablet f81a35dbe00342f89c4a42a3cfbbeacc (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.564563 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81a35dbe00342f89c4a42a3cfbbeacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.564720 26341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81a35dbe00342f89c4a42a3cfbbeacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.566871 26339 tablet_service.cc:1467] Processing CreateTablet for tablet e25072f604644d9595c95c1bd5bfd7db (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.567158 26339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25072f604644d9595c95c1bd5bfd7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.564025 26340 tablet_service.cc:1467] Processing CreateTablet for tablet bf4199a73df149368fb8d04f4c9723ef (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.568051 26340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4199a73df149368fb8d04f4c9723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.569200 26472 tablet_service.cc:1467] Processing CreateTablet for tablet bf4199a73df149368fb8d04f4c9723ef (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.568965 26471 tablet_service.cc:1467] Processing CreateTablet for tablet e25072f604644d9595c95c1bd5bfd7db (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.568965 26473 tablet_service.cc:1467] Processing CreateTablet for tablet f81a35dbe00342f89c4a42a3cfbbeacc (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.569948 26472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4199a73df149368fb8d04f4c9723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.570446 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25072f604644d9595c95c1bd5bfd7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.560019 26604 tablet_service.cc:1467] Processing CreateTablet for tablet bf4199a73df149368fb8d04f4c9723ef (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.571403 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4199a73df149368fb8d04f4c9723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.573951 26473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81a35dbe00342f89c4a42a3cfbbeacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.574023 26077 tablet_service.cc:1467] Processing CreateTablet for tablet f81a35dbe00342f89c4a42a3cfbbeacc (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.574374 26737 tablet_service.cc:1467] Processing CreateTablet for tablet f81a35dbe00342f89c4a42a3cfbbeacc (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.574903 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81a35dbe00342f89c4a42a3cfbbeacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.575268 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81a35dbe00342f89c4a42a3cfbbeacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.576013 26076 tablet_service.cc:1467] Processing CreateTablet for tablet bf4199a73df149368fb8d04f4c9723ef (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.576299 26076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4199a73df149368fb8d04f4c9723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.577620 26736 tablet_service.cc:1467] Processing CreateTablet for tablet bf4199a73df149368fb8d04f4c9723ef (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.577934 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4199a73df149368fb8d04f4c9723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.581478 27226 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:07.581528 26075 tablet_service.cc:1467] Processing CreateTablet for tablet e25072f604644d9595c95c1bd5bfd7db (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.581771 26075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25072f604644d9595c95c1bd5bfd7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.582244 26735 tablet_service.cc:1467] Processing CreateTablet for tablet e25072f604644d9595c95c1bd5bfd7db (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.582507 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25072f604644d9595c95c1bd5bfd7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.583295 26207 tablet_service.cc:1467] Processing CreateTablet for tablet e25072f604644d9595c95c1bd5bfd7db (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.583565 26207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25072f604644d9595c95c1bd5bfd7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.583621 27229 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:07.583856 27226 tablet_bootstrap.cc:654] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.584692 27226 log.cc:824] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:07.585757 27229 tablet_bootstrap.cc:654] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.586911 25945 tablet_service.cc:1467] Processing CreateTablet for tablet e25072f604644d9595c95c1bd5bfd7db (DEFAULT_TABLE table=rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:07.587230 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25072f604644d9595c95c1bd5bfd7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:07.587427 27229 log.cc:824] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:07.588553 27231 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:07.589257 27228 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:07.590641 27232 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:07.592260 27228 tablet_bootstrap.cc:654] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.592535 27231 tablet_bootstrap.cc:654] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.593370 27228 log.cc:824] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:07.593356 27231 log.cc:824] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:07.593406 27232 tablet_bootstrap.cc:654] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.594041 27227 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:07.594518 27232 log.cc:824] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:07.595171 27234 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:07.595291 27229 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:07.595341 27231 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:07.595464 27229 ts_tablet_manager.cc:1367] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20240502 20:47:07.595489 27231 ts_tablet_manager.cc:1367] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20240502 20:47:07.595960 27227 tablet_bootstrap.cc:654] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.596642 27227 log.cc:824] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:07.597038 27234 tablet_bootstrap.cc:654] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.598258 27234 log.cc:824] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:07.598347 27226 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:07.598521 27226 ts_tablet_manager.cc:1367] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.004s
I20240502 20:47:07.599210 27231 raft_consensus.cc:348] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.599581 27231 raft_consensus.cc:374] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.599697 27231 raft_consensus.cc:729] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.599830 27228 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:07.600006 27228 ts_tablet_manager.cc:1367] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20240502 20:47:07.600291 27229 raft_consensus.cc:348] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.600595 27229 raft_consensus.cc:374] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.600554 27231 consensus_queue.cc:260] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.600695 27229 raft_consensus.cc:729] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.601173 27229 consensus_queue.cc:260] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.601547 27231 ts_tablet_manager.cc:1398] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20240502 20:47:07.602056 27229 ts_tablet_manager.cc:1398] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20240502 20:47:07.602308 27226 raft_consensus.cc:348] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.602519 27226 raft_consensus.cc:374] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.602588 27226 raft_consensus.cc:729] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.602620 27229 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:07.602973 27226 consensus_queue.cc:260] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.603768 27229 tablet_bootstrap.cc:654] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.604849 27229 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:07.604868 27227 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:07.604935 27232 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:07.605036 27229 ts_tablet_manager.cc:1367] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 20:47:07.605036 27227 ts_tablet_manager.cc:1367] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20240502 20:47:07.605149 27232 ts_tablet_manager.cc:1367] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20240502 20:47:07.605693 27229 raft_consensus.cc:348] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.605875 27229 raft_consensus.cc:374] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.605952 27229 raft_consensus.cc:729] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.606163 27229 consensus_queue.cc:260] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.606575 27229 ts_tablet_manager.cc:1398] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:07.606806 27229 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:07.607802 27229 tablet_bootstrap.cc:654] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.608271 27231 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:07.608649 27227 raft_consensus.cc:348] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.608690 27232 raft_consensus.cc:348] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.608899 27232 raft_consensus.cc:374] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.608901 27227 raft_consensus.cc:374] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.608956 27232 raft_consensus.cc:729] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.608955 27227 raft_consensus.cc:729] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.609285 27229 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:07.609354 27229 ts_tablet_manager.cc:1367] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:47:07.609360 27227 consensus_queue.cc:260] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.609361 27232 consensus_queue.cc:260] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.610209 27232 ts_tablet_manager.cc:1398] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 20:47:07.610216 27227 ts_tablet_manager.cc:1398] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 20:47:07.610554 27227 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:07.610587 27232 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:07.611474 27227 tablet_bootstrap.cc:654] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.611519 27232 tablet_bootstrap.cc:654] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.611804 27229 raft_consensus.cc:348] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.611891 27226 ts_tablet_manager.cc:1398] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20240502 20:47:07.611924 27229 raft_consensus.cc:374] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.611956 27229 raft_consensus.cc:729] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.612143 27226 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:07.612116 27229 consensus_queue.cc:260] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.612484 27229 ts_tablet_manager.cc:1398] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:47:07.613134 27226 tablet_bootstrap.cc:654] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.613171 27228 raft_consensus.cc:348] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.613482 27228 raft_consensus.cc:374] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.613557 27228 raft_consensus.cc:729] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.614063 27228 consensus_queue.cc:260] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.615015 27228 ts_tablet_manager.cc:1398] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20240502 20:47:07.615365 27228 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:07.615833 27226 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:07.615932 27227 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:07.615980 27226 ts_tablet_manager.cc:1367] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:47:07.616096 27227 ts_tablet_manager.cc:1367] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:47:07.616364 27228 tablet_bootstrap.cc:654] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.616559 27226 raft_consensus.cc:348] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.616690 27226 raft_consensus.cc:374] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.616730 27226 raft_consensus.cc:729] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.616819 27227 raft_consensus.cc:348] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.616873 27226 consensus_queue.cc:260] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.617029 27227 raft_consensus.cc:374] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.617110 27227 raft_consensus.cc:729] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.617262 27226 ts_tablet_manager.cc:1398] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:07.617278 27227 consensus_queue.cc:260] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.617441 27226 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:07.617672 27227 ts_tablet_manager.cc:1398] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:07.617985 27227 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:07.618373 27226 tablet_bootstrap.cc:654] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.618587 27234 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:07.618844 27234 ts_tablet_manager.cc:1367] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20240502 20:47:07.619158 27227 tablet_bootstrap.cc:654] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.620172 27227 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:07.620260 27227 ts_tablet_manager.cc:1367] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:07.620626 27227 raft_consensus.cc:348] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.620723 27227 raft_consensus.cc:374] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.620759 27227 raft_consensus.cc:729] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.620882 27227 consensus_queue.cc:260] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.621129 27227 ts_tablet_manager.cc:1398] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:07.621726 27226 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:07.621825 27226 ts_tablet_manager.cc:1367] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:47:07.622388 27234 raft_consensus.cc:348] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.622737 27234 raft_consensus.cc:374] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.622854 27234 raft_consensus.cc:729] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.622865 27226 raft_consensus.cc:348] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.623093 27226 raft_consensus.cc:374] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.623174 27226 raft_consensus.cc:729] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.623381 27226 consensus_queue.cc:260] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.623427 27234 consensus_queue.cc:260] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.623622 27231 tablet_bootstrap.cc:654] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.623908 27226 ts_tablet_manager.cc:1398] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:07.624521 27234 ts_tablet_manager.cc:1398] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20240502 20:47:07.624954 27234 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:07.625113 27232 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:07.625281 27232 ts_tablet_manager.cc:1367] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20240502 20:47:07.625705 27228 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:07.625850 27228 ts_tablet_manager.cc:1367] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 20:47:07.625960 27234 tablet_bootstrap.cc:654] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.626003 27232 raft_consensus.cc:348] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.626181 27232 raft_consensus.cc:374] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.626253 27232 raft_consensus.cc:729] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.626456 27232 consensus_queue.cc:260] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.626469 27228 raft_consensus.cc:348] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.626576 27228 raft_consensus.cc:374] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.626664 27228 raft_consensus.cc:729] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.626892 27232 ts_tablet_manager.cc:1398] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:07.626828 27228 consensus_queue.cc:260] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.627117 27232 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:07.627197 27228 ts_tablet_manager.cc:1398] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:07.627378 27228 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:07.627424 27234 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:07.627502 27234 ts_tablet_manager.cc:1367] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:07.628090 27234 raft_consensus.cc:348] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.628199 27234 raft_consensus.cc:374] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.628225 27234 raft_consensus.cc:729] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.628335 27234 consensus_queue.cc:260] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.628388 27232 tablet_bootstrap.cc:654] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.628388 27228 tablet_bootstrap.cc:654] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.628664 27234 ts_tablet_manager.cc:1398] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:07.628804 27234 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:07.629608 27234 tablet_bootstrap.cc:654] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.630686 27234 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:07.630775 27234 ts_tablet_manager.cc:1367] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:07.631155 27234 raft_consensus.cc:348] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.631263 27234 raft_consensus.cc:374] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.631290 27234 raft_consensus.cc:729] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.631407 27234 consensus_queue.cc:260] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.631680 27234 ts_tablet_manager.cc:1398] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:07.633241 27231 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:07.633358 27231 ts_tablet_manager.cc:1367] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20240502 20:47:07.633917 27231 raft_consensus.cc:348] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.634028 27231 raft_consensus.cc:374] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.634063 27231 raft_consensus.cc:729] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.634197 27231 consensus_queue.cc:260] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.634439 27231 ts_tablet_manager.cc:1398] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:07.634620 27231 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:07.636564 27231 tablet_bootstrap.cc:654] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:07.639057 27232 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:07.639267 27232 ts_tablet_manager.cc:1367] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
W20240502 20:47:07.639499 26672 tablet.cc:2369] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:47:07.639885 27232 raft_consensus.cc:348] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.640182 27232 raft_consensus.cc:374] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.640241 27232 raft_consensus.cc:729] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.640496 27231 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:07.640425 27232 consensus_queue.cc:260] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.640597 27231 ts_tablet_manager.cc:1367] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:47:07.640724 27228 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:07.640822 27228 ts_tablet_manager.cc:1367] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 20:47:07.640851 27232 ts_tablet_manager.cc:1398] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:07.641093 27231 raft_consensus.cc:348] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.641228 27231 raft_consensus.cc:374] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.641280 27231 raft_consensus.cc:729] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.641428 27231 consensus_queue.cc:260] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.641502 27228 raft_consensus.cc:348] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.641642 27228 raft_consensus.cc:374] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:07.641674 27228 raft_consensus.cc:729] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:07.641781 27231 ts_tablet_manager.cc:1398] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:07.641935 27228 consensus_queue.cc:260] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.642258 27228 ts_tablet_manager.cc:1398] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20240502 20:47:07.652243 26012 tablet.cc:2369] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:47:07.661327 27246 raft_consensus.cc:482] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:07.661542 27246 raft_consensus.cc:504] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.663602 27246 leader_election.cc:288] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:07.670511 26097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:07.670858 26097 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:07.672184 26361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:07.672317 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:07.671905 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:07.672566 26361 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:07.672621 25965 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:07.672701 26757 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:07.673013 26560 leader_election.cc:302] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:07.673303 27246 raft_consensus.cc:2781] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:07.673388 27246 raft_consensus.cc:482] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:07.673441 27246 raft_consensus.cc:3037] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.674062 26229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:07.674329 26229 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:07.674695 27246 raft_consensus.cc:504] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.675318 27246 leader_election.cc:288] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 election: Requested vote from peers 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:07.675640 26097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:07.675786 26229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:07.675871 26097 raft_consensus.cc:3037] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.675916 26229 raft_consensus.cc:3037] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.676820 26229 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:07.677182 26097 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:07.677731 26361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:07.677783 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:07.677878 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:07.677902 26361 raft_consensus.cc:3037] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.677917 25965 raft_consensus.cc:3037] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.678017 26757 raft_consensus.cc:3037] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.678817 26361 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:07.679090 25965 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:07.679090 26757 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:07.679404 26560 leader_election.cc:302] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:07.679605 27246 raft_consensus.cc:2781] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:07.679926 27246 raft_consensus.cc:686] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Becoming Leader. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Running, Role: LEADER
I20240502 20:47:07.680341 27246 consensus_queue.cc:237] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:07.682737 26493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:07.683084 26493 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:07.683706 27251 raft_consensus.cc:482] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:07.684088 27251 raft_consensus.cc:504] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.685999 27251 leader_election.cc:288] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:07.689934 25822 catalog_manager.cc:5484] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134). New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:07.693936 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:07.694096 26757 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:07.694367 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81a35dbe00342f89c4a42a3cfbbeacc" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:07.694526 26492 raft_consensus.cc:3037] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.695468 26492 raft_consensus.cc:2454] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:07.695996 26229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:07.696131 26229 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:07.696452 27242 raft_consensus.cc:482] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:07.696568 27242 raft_consensus.cc:504] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.696995 27249 raft_consensus.cc:482] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:07.697083 27249 raft_consensus.cc:504] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.697587 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:07.697697 26492 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:07.698012 25900 leader_election.cc:302] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 6173ed1979b94e509bf1c843a5183690, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3; no voters:
I20240502 20:47:07.698132 27242 leader_election.cc:288] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:07.698491 27249 leader_election.cc:288] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:07.698663 27251 raft_consensus.cc:2781] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:07.698726 27251 raft_consensus.cc:482] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:07.698791 27251 raft_consensus.cc:3037] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
W20240502 20:47:07.703496 26540 tablet.cc:2369] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 20:47:07.709854 27251 raft_consensus.cc:504] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.710393 26097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:07.710494 27251 leader_election.cc:288] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [CANDIDATE]: Term 1 election: Requested vote from peers bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:07.710559 26097 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:07.711037 26229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:07.711160 26229 raft_consensus.cc:3037] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.711133 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:07.711256 26492 raft_consensus.cc:3037] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.711838 26097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:07.711943 26097 raft_consensus.cc:3037] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.712218 26229 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:07.712278 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:07.712468 26625 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:07.712764 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:07.712874 26624 raft_consensus.cc:3037] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.712961 26097 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:07.712930 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:07.713060 26757 raft_consensus.cc:3037] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.713582 26229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:07.713650 26492 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:07.713707 26229 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:07.713908 26624 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:07.713981 25900 leader_election.cc:302] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2; no voters:
I20240502 20:47:07.714093 26757 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:07.715343 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:07.715466 26757 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:07.715546 27251 raft_consensus.cc:2781] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:07.715801 27251 raft_consensus.cc:686] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Becoming Leader. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Running, Role: LEADER
I20240502 20:47:07.716073 26361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:07.716130 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf4199a73df149368fb8d04f4c9723ef" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:07.716208 26361 raft_consensus.cc:2454] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:07.716205 27251 consensus_queue.cc:237] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.716324 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:07.716439 26492 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:07.716702 26296 leader_election.cc:302] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 6173ed1979b94e509bf1c843a5183690, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:07.716954 27242 raft_consensus.cc:2781] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:07.717018 27242 raft_consensus.cc:482] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:07.717056 27242 raft_consensus.cc:3037] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.718047 27242 raft_consensus.cc:504] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.718652 27242 leader_election.cc:288] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Requested vote from peers 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:07.719323 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:07.719426 26492 raft_consensus.cc:3037] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.720412 26492 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:07.720705 25822 catalog_manager.cc:5484] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129). New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:07.720995 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:07.721110 25965 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:07.721325 25964 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:07.721414 25964 raft_consensus.cc:3037] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.722393 26097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:07.722429 25964 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:07.722524 26097 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:07.724730 26097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:07.724853 26097 raft_consensus.cc:3037] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.725258 25964 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:07.725425 25964 raft_consensus.cc:2379] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9aaa16c4fc46478f90a3d97b010330c2 in current term 1: Already voted for candidate bbee1301f7b94c6ab339ecaccc4ce740 in this term.
I20240502 20:47:07.725673 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:07.725899 26097 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:07.726270 26295 leader_election.cc:302] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:07.726517 27242 raft_consensus.cc:2781] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:07.726742 27242 raft_consensus.cc:686] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Becoming Leader. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Running, Role: LEADER
I20240502 20:47:07.727126 27242 consensus_queue.cc:237] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:07.727300 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:07.727421 26624 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:07.728029 26229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:07.728168 26229 raft_consensus.cc:3037] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.729161 26229 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:07.729398 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:07.729938 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:07.730073 26757 raft_consensus.cc:3037] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.730594 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:07.730950 26757 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:07.731199 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:07.731191 26429 leader_election.cc:302] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 6 responses out of 7 voters: 2 yes votes; 4 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 9aaa16c4fc46478f90a3d97b010330c2; no voters: 3c6dc91a7df244ab82c1161799ba2ff3, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740
I20240502 20:47:07.731325 26625 raft_consensus.cc:3037] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.731484 27249 raft_consensus.cc:2726] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 20:47:07.732378 26625 raft_consensus.cc:2454] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:07.732611 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:07.732745 26624 raft_consensus.cc:2362] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1. Re-sending same reply.
I20240502 20:47:07.733737 26229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e25072f604644d9595c95c1bd5bfd7db" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:07.733923 26229 raft_consensus.cc:2379] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9aaa16c4fc46478f90a3d97b010330c2 in current term 1: Already voted for candidate bbee1301f7b94c6ab339ecaccc4ce740 in this term.
I20240502 20:47:07.734885 25822 catalog_manager.cc:5484] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
W20240502 20:47:07.759161 26408 tablet.cc:2369] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 20:47:07.826539 26276 tablet.cc:2369] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 20:47:07.843058 26804 tablet.cc:2369] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 20:47:07.850720 26144 tablet.cc:2369] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 20:47:07.862926 27302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:07.863173 27302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:07.866289 27302 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_0'
I20240502 20:47:07.954173 26360 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.955101 26492 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.955778 27246 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.956513 26757 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.957020 26229 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.957530 27298 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.958097 26228 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.958357 26360 raft_consensus.cc:3037] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:07.958819 26097 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.959285 26096 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.959560 26360 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.959652 26493 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.960592 26624 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.960786 25964 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.961360 27246 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.957687 26756 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.961716 27270 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.962071 27270 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.962975 27251 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.963371 27251 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.963711 27251 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.964021 27251 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.967240 26756 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.967743 27300 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.968963 27246 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.969201 27298 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.969386 27246 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.970494 26096 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.972681 27300 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.975525 26625 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.976430 25964 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.978267 26491 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.978657 26227 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:07.979085 27300 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.979974 27300 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.980125 27242 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:07.980456 27242 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.007175 27331 mvcc.cc:205] Tried to move back new op lower bound from 7023340863321595904 to 7023340862330691584. Current Snapshot: MvccSnapshot[applied={T|T < 7023340863299493888}]
I20240502 20:47:08.008765 27350 mvcc.cc:205] Tried to move back new op lower bound from 7023340863321595904 to 7023340862330691584. Current Snapshot: MvccSnapshot[applied={T|T < 7023340863299493888}]
I20240502 20:47:08.009395 27336 mvcc.cc:205] Tried to move back new op lower bound from 7023340863321595904 to 7023340862330691584. Current Snapshot: MvccSnapshot[applied={T|T < 7023340863299493888}]
I20240502 20:47:08.030714 27330 mvcc.cc:205] Tried to move back new op lower bound from 7023340863321595904 to 7023340862330691584. Current Snapshot: MvccSnapshot[applied={T|T < 7023340863299493888}]
I20240502 20:47:08.031531 27338 mvcc.cc:205] Tried to move back new op lower bound from 7023340863321595904 to 7023340862330691584. Current Snapshot: MvccSnapshot[applied={T|T < 7023340863299493888}]
I20240502 20:47:08.083446 27370 mvcc.cc:205] Tried to move back new op lower bound from 7023340863321595904 to 7023340862330691584. Current Snapshot: MvccSnapshot[applied={T|T < 7023340863299493888}]
I20240502 20:47:08.095345 27368 mvcc.cc:205] Tried to move back new op lower bound from 7023340863321112576 to 7023340862183882752. Current Snapshot: MvccSnapshot[applied={T|T < 7023340863293190144}]
INSERT report
rows total: 2000
time total: 199.37 ms
time per row: 0.0996849 ms
I20240502 20:47:08.118808 25820 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52614:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:47:08.119381 25820 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_1 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 20:47:08.127646 25945 tablet_service.cc:1467] Processing CreateTablet for tablet 8659718d503141fa8a8024b700683858 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.128036 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.128299 26075 tablet_service.cc:1467] Processing CreateTablet for tablet 8659718d503141fa8a8024b700683858 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.129877 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 8659718d503141fa8a8024b700683858 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.130177 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.130436 25944 tablet_service.cc:1467] Processing CreateTablet for tablet ec36083ee0ce441c9b2337a48d41a5fc (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.130676 25944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec36083ee0ce441c9b2337a48d41a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.132797 26736 tablet_service.cc:1467] Processing CreateTablet for tablet ec36083ee0ce441c9b2337a48d41a5fc (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.133049 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec36083ee0ce441c9b2337a48d41a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.133122 26605 tablet_service.cc:1467] Processing CreateTablet for tablet 8659718d503141fa8a8024b700683858 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.133399 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.135027 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.135269 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.135636 26603 tablet_service.cc:1467] Processing CreateTablet for tablet ec36083ee0ce441c9b2337a48d41a5fc (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.135862 27228 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:08.135928 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec36083ee0ce441c9b2337a48d41a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.136775 27228 tablet_bootstrap.cc:654] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.137595 26604 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.137749 27231 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:08.137795 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.138531 27231 tablet_bootstrap.cc:654] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.127646 25943 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.139484 25943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.140733 26208 tablet_service.cc:1467] Processing CreateTablet for tablet ec36083ee0ce441c9b2337a48d41a5fc (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.141006 26208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec36083ee0ce441c9b2337a48d41a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.141568 26207 tablet_service.cc:1467] Processing CreateTablet for tablet 8659718d503141fa8a8024b700683858 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.141736 26339 tablet_service.cc:1467] Processing CreateTablet for tablet ec36083ee0ce441c9b2337a48d41a5fc (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.141829 26207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.142032 26339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec36083ee0ce441c9b2337a48d41a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.143409 26209 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.143640 26209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.143888 26341 tablet_service.cc:1467] Processing CreateTablet for tablet 8659718d503141fa8a8024b700683858 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.144026 26473 tablet_service.cc:1467] Processing CreateTablet for tablet ec36083ee0ce441c9b2337a48d41a5fc (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.144129 26341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.144323 26473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec36083ee0ce441c9b2337a48d41a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.144510 26472 tablet_service.cc:1467] Processing CreateTablet for tablet 8659718d503141fa8a8024b700683858 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.144763 26472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.146185 26340 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.146433 26340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.146656 26471 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.146909 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.148759 26075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.128808 26077 tablet_service.cc:1467] Processing CreateTablet for tablet ec36083ee0ce441c9b2337a48d41a5fc (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.151312 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec36083ee0ce441c9b2337a48d41a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.152866 27403 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:08.129104 26076 tablet_service.cc:1467] Processing CreateTablet for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.153390 26076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.153980 27402 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:08.155102 27402 tablet_bootstrap.cc:654] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.155820 27404 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:08.157171 27403 tablet_bootstrap.cc:654] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.157227 27399 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:08.159319 27405 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:08.160331 27399 tablet_bootstrap.cc:654] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.160881 27404 tablet_bootstrap.cc:654] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.164633 27403 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:08.164744 27403 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20240502 20:47:08.165205 27403 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.165339 27403 raft_consensus.cc:374] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.165376 27403 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.165531 27403 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.165810 27403 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.165977 27403 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:08.166234 27405 tablet_bootstrap.cc:654] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.166987 27403 tablet_bootstrap.cc:654] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.167418 27402 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:08.167528 27402 ts_tablet_manager.cc:1367] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20240502 20:47:08.168033 27402 raft_consensus.cc:348] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.168191 27402 raft_consensus.cc:374] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.168231 27402 raft_consensus.cc:729] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.168454 27231 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:08.168546 27231 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.000s
I20240502 20:47:08.168722 27399 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:08.168815 27399 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20240502 20:47:08.169018 27231 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.169170 27231 raft_consensus.cc:374] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.169209 27231 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.169401 27404 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:08.169346 27231 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.169485 27404 ts_tablet_manager.cc:1367] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20240502 20:47:08.169636 27231 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.169816 27231 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:08.170485 27399 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.170581 27403 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:08.170619 27399 raft_consensus.cc:374] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.170651 27399 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.170662 27403 ts_tablet_manager.cc:1367] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 20:47:08.170730 27231 tablet_bootstrap.cc:654] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.171094 27404 raft_consensus.cc:348] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.171090 27403 raft_consensus.cc:348] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.171226 27403 raft_consensus.cc:374] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.171223 27404 raft_consensus.cc:374] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.171258 27403 raft_consensus.cc:729] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.171258 27404 raft_consensus.cc:729] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.170046 27405 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:08.171479 27405 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20240502 20:47:08.171386 27403 consensus_queue.cc:260] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.171979 27228 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:08.172091 27228 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.001s
I20240502 20:47:08.172159 27403 ts_tablet_manager.cc:1398] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:08.172109 27405 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.172236 27405 raft_consensus.cc:374] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.172271 27405 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.172353 27403 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:08.172493 27402 consensus_queue.cc:260] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.172580 27228 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.172706 27228 raft_consensus.cc:374] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.172742 27228 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.172847 27399 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.172870 27228 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.173074 27404 consensus_queue.cc:260] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.173183 27228 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:08.173321 27403 tablet_bootstrap.cc:654] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.173339 27228 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:08.174101 27399 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240502 20:47:08.174217 27228 tablet_bootstrap.cc:654] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.174276 27399 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:08.175173 27399 tablet_bootstrap.cc:654] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.175894 27404 ts_tablet_manager.cc:1398] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20240502 20:47:08.176064 27404 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:08.176287 27231 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:08.176383 27231 ts_tablet_manager.cc:1367] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 20:47:08.176896 27231 raft_consensus.cc:348] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.177023 27231 raft_consensus.cc:374] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.177042 27404 tablet_bootstrap.cc:654] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.177060 27231 raft_consensus.cc:729] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.177204 27231 consensus_queue.cc:260] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.177484 27231 ts_tablet_manager.cc:1398] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.177644 27231 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:08.178205 27402 ts_tablet_manager.cc:1398] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20240502 20:47:08.178413 27402 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:08.178943 27231 tablet_bootstrap.cc:654] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.179229 27402 tablet_bootstrap.cc:654] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.179881 27405 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.180081 27228 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:08.180186 27228 ts_tablet_manager.cc:1367] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20240502 20:47:08.180280 27405 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20240502 20:47:08.180480 27405 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:08.180632 27228 raft_consensus.cc:348] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.180770 27228 raft_consensus.cc:374] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.180811 27228 raft_consensus.cc:729] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.180943 27228 consensus_queue.cc:260] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.181263 27228 ts_tablet_manager.cc:1398] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:08.181427 27228 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:08.181454 27405 tablet_bootstrap.cc:654] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.182353 27228 tablet_bootstrap.cc:654] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.182747 27403 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:08.182871 27403 ts_tablet_manager.cc:1367] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 20:47:08.183106 27231 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:08.183246 27231 ts_tablet_manager.cc:1367] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:47:08.183377 27403 raft_consensus.cc:348] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.183521 27403 raft_consensus.cc:374] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.183555 27399 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:08.183563 27403 raft_consensus.cc:729] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.183668 27399 ts_tablet_manager.cc:1367] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20240502 20:47:08.183708 27403 consensus_queue.cc:260] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.184041 27403 ts_tablet_manager.cc:1398] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:08.184151 27399 raft_consensus.cc:348] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.184269 27399 raft_consensus.cc:374] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.184301 27399 raft_consensus.cc:729] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.184464 27399 consensus_queue.cc:260] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.184760 27399 ts_tablet_manager.cc:1398] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.184918 27399 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:08.185940 27399 tablet_bootstrap.cc:654] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.186285 27231 raft_consensus.cc:348] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.186480 27231 raft_consensus.cc:374] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.186564 27231 raft_consensus.cc:729] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.186602 27228 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:08.186699 27228 ts_tablet_manager.cc:1367] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240502 20:47:08.186862 27402 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:08.186836 27231 consensus_queue.cc:260] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.186976 27402 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20240502 20:47:08.187176 27228 raft_consensus.cc:348] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.187309 27228 raft_consensus.cc:374] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.187350 27228 raft_consensus.cc:729] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.187474 27231 ts_tablet_manager.cc:1398] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:47:08.187485 27228 consensus_queue.cc:260] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.187494 27402 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.187628 27402 raft_consensus.cc:374] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.187664 27402 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.187821 27228 ts_tablet_manager.cc:1398] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.187848 27402 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.188161 27402 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.188328 27402 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:08.189327 27402 tablet_bootstrap.cc:654] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.189433 27405 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:08.189529 27405 ts_tablet_manager.cc:1367] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20240502 20:47:08.189610 27404 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:08.189702 27404 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20240502 20:47:08.190160 27404 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.190287 27404 raft_consensus.cc:374] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.190205 27405 raft_consensus.cc:348] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.190318 27404 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.190335 27405 raft_consensus.cc:374] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.190369 27405 raft_consensus.cc:729] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.190449 27404 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.190737 27404 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.190670 27405 consensus_queue.cc:260] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.190919 27404 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:08.191169 27402 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:08.191255 27402 ts_tablet_manager.cc:1367] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:08.191772 27405 ts_tablet_manager.cc:1398] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 20:47:08.191677 27402 raft_consensus.cc:348] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.191838 27402 raft_consensus.cc:374] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.191881 27402 raft_consensus.cc:729] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.191915 27404 tablet_bootstrap.cc:654] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.192026 27402 consensus_queue.cc:260] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.192203 27405 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:08.192333 27402 ts_tablet_manager.cc:1398] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.192965 27399 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:08.193097 27399 ts_tablet_manager.cc:1367] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 20:47:08.193518 27405 tablet_bootstrap.cc:654] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.193588 27399 raft_consensus.cc:348] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.193755 27399 raft_consensus.cc:374] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.193789 27399 raft_consensus.cc:729] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.193938 27399 consensus_queue.cc:260] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.194245 27399 ts_tablet_manager.cc:1398] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.194758 27404 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:08.194829 27404 ts_tablet_manager.cc:1367] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:47:08.194983 27405 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:08.195051 27405 ts_tablet_manager.cc:1367] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:08.195262 27404 raft_consensus.cc:348] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.195379 27404 raft_consensus.cc:374] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.195410 27404 raft_consensus.cc:729] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.195523 27404 consensus_queue.cc:260] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.195562 27405 raft_consensus.cc:348] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.195861 27404 ts_tablet_manager.cc:1398] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.195968 27405 raft_consensus.cc:374] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.196024 27405 raft_consensus.cc:729] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.196162 27405 consensus_queue.cc:260] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.196446 27405 ts_tablet_manager.cc:1398] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.227532 27354 raft_consensus.cc:482] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:08.227687 27354 raft_consensus.cc:504] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.229393 27354 leader_election.cc:288] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:08.234516 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:08.234692 26360 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.235219 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:08.235380 26757 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.235570 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:08.235714 26625 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.236063 26031 leader_election.cc:302] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.236353 27354 raft_consensus.cc:2781] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:08.236419 27354 raft_consensus.cc:482] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:08.236459 27354 raft_consensus.cc:3037] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.236647 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:08.236791 26228 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.237607 27354 raft_consensus.cc:504] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.238312 27354 leader_election.cc:288] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Requested vote from peers bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:08.238332 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:08.238451 26360 raft_consensus.cc:3037] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.238721 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:08.238834 26757 raft_consensus.cc:3037] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.239478 26360 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.239750 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:08.239842 26757 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.239883 26228 raft_consensus.cc:3037] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.240352 25964 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:08.240455 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:08.240520 25964 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.240569 26625 raft_consensus.cc:3037] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.240552 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:08.240352 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:08.240684 25965 raft_consensus.cc:3037] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.240677 26491 raft_consensus.cc:3037] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.240949 26228 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.241179 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c4c0137c6aa4820b0f0a5cf001c56d1" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:08.241578 25965 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.241577 26491 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.241593 26625 raft_consensus.cc:2454] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.241864 26031 leader_election.cc:302] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.242080 27354 raft_consensus.cc:2781] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:08.242200 27354 raft_consensus.cc:686] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Becoming Leader. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Running, Role: LEADER
I20240502 20:47:08.242522 27354 consensus_queue.cc:237] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:08.245245 25818 catalog_manager.cc:5484] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73a41df730ef429d84fe648df03a2701 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:08.282862 27354 raft_consensus.cc:482] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:08.283053 27354 raft_consensus.cc:504] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.283923 27354 leader_election.cc:288] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.284251 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:08.284289 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:08.284272 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:08.284409 26625 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.284409 26228 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.284426 25965 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.284631 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:08.284772 26491 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.284847 26032 leader_election.cc:302] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701; no voters:
I20240502 20:47:08.284835 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:08.284972 26360 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.285110 27354 raft_consensus.cc:2781] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:08.285108 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:08.285182 27354 raft_consensus.cc:482] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:08.285236 27354 raft_consensus.cc:3037] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.285239 26757 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:08.286145 27354 raft_consensus.cc:504] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.286691 27354 leader_election.cc:288] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Requested vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.286916 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:08.286918 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:08.287026 26625 raft_consensus.cc:3037] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.287026 26360 raft_consensus.cc:3037] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.287065 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:08.287181 26228 raft_consensus.cc:3037] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.287192 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:08.287298 25965 raft_consensus.cc:3037] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.288014 26625 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.288014 26360 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.288197 25965 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.288192 26228 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.288441 26032 leader_election.cc:302] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.288524 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:08.288664 26491 raft_consensus.cc:3037] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.288856 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec36083ee0ce441c9b2337a48d41a5fc" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:08.288982 26757 raft_consensus.cc:3037] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.289631 26491 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.288676 27354 raft_consensus.cc:2781] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:08.289891 27354 raft_consensus.cc:686] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Becoming Leader. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Running, Role: LEADER
I20240502 20:47:08.289959 26757 raft_consensus.cc:2454] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:08.290068 27354 consensus_queue.cc:237] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.292186 25818 catalog_manager.cc:5484] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73a41df730ef429d84fe648df03a2701 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:08.308419 27382 raft_consensus.cc:482] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:08.308562 27382 raft_consensus.cc:504] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.309226 27382 leader_election.cc:288] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.309598 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:08.309598 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:08.309657 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:08.309743 26491 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:08.309743 25965 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:08.309828 26360 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:08.310041 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:08.310110 26560 leader_election.cc:302] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 9aaa16c4fc46478f90a3d97b010330c2, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.310189 26096 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:08.310286 27382 raft_consensus.cc:2781] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:08.310241 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:08.310326 27382 raft_consensus.cc:482] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:08.310360 27382 raft_consensus.cc:3037] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.310379 26757 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:08.310576 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:08.310737 26228 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:08.311399 27382 raft_consensus.cc:504] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.312088 27382 leader_election.cc:288] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 election: Requested vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.312296 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:08.312296 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:08.312402 26096 raft_consensus.cc:3037] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.312402 26360 raft_consensus.cc:3037] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.312384 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:08.312497 26491 raft_consensus.cc:3037] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.312783 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:08.312891 26757 raft_consensus.cc:3037] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.313445 26360 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:08.313457 26491 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:08.313827 26096 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:08.313868 26757 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:08.313993 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:08.314107 25965 raft_consensus.cc:3037] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.314106 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8659718d503141fa8a8024b700683858" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:08.314185 26561 leader_election.cc:302] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.314220 26228 raft_consensus.cc:3037] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.314368 27382 raft_consensus.cc:2781] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:08.314457 27382 raft_consensus.cc:686] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Becoming Leader. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Running, Role: LEADER
I20240502 20:47:08.314597 27382 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.315026 25965 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:08.315483 26228 raft_consensus.cc:2454] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:08.316926 25818 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134). New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
W20240502 20:47:08.432616 27437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:08.432933 27437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:08.436144 27437 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_1'
I20240502 20:47:08.534811 26360 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.535336 27335 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.540313 26757 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.540709 26755 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.541389 26491 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.541474 26228 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.541923 27335 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.542589 27469 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.544004 25965 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.544754 26625 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.546689 26360 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.546980 26625 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.547457 26757 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.548128 25964 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.548521 27335 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.548565 26227 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.548748 26491 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.549851 26491 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.549970 26360 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.550424 27335 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.551131 26228 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.551515 27335 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.551865 25965 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.558012 27468 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.547983 27475 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.562749 27471 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.563169 27354 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.550514 26096 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:08.564296 27335 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.565712 27247 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.570513 27476 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.572147 27477 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.572654 27470 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.572943 27473 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.573249 27480 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:08.575771 27474 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 218.167 ms
time per row: 0.109084 ms
I20240502 20:47:08.705019 25818 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52614:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:47:08.705633 25818 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_2 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 20:47:08.711673 25943 tablet_service.cc:1467] Processing CreateTablet for tablet d8efe0d8a46e47a59900e07e6430cd37 (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.711889 26209 tablet_service.cc:1467] Processing CreateTablet for tablet d8efe0d8a46e47a59900e07e6430cd37 (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.712029 25943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8efe0d8a46e47a59900e07e6430cd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.712190 26209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8efe0d8a46e47a59900e07e6430cd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.712412 26735 tablet_service.cc:1467] Processing CreateTablet for tablet d8efe0d8a46e47a59900e07e6430cd37 (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.712669 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8efe0d8a46e47a59900e07e6430cd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.713903 26076 tablet_service.cc:1467] Processing CreateTablet for tablet d8efe0d8a46e47a59900e07e6430cd37 (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.714213 26076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8efe0d8a46e47a59900e07e6430cd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.715072 26604 tablet_service.cc:1467] Processing CreateTablet for tablet d8efe0d8a46e47a59900e07e6430cd37 (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.715359 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8efe0d8a46e47a59900e07e6430cd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.715860 26735 tablet_service.cc:1467] Processing CreateTablet for tablet cacd9a8959094a24b6f7572e973ef71f (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.715914 26736 tablet_service.cc:1467] Processing CreateTablet for tablet adb68aca646d42b2a869eaab1e3e805b (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.716066 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.716256 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.717581 27520 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:08.717725 26603 tablet_service.cc:1467] Processing CreateTablet for tablet cacd9a8959094a24b6f7572e973ef71f (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.717972 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.718605 27520 tablet_bootstrap.cc:654] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.719563 27520 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:08.719658 27520 ts_tablet_manager.cc:1367] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:08.719921 26605 tablet_service.cc:1467] Processing CreateTablet for tablet adb68aca646d42b2a869eaab1e3e805b (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.720177 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.720095 27520 raft_consensus.cc:348] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.720244 27520 raft_consensus.cc:374] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.720300 27520 raft_consensus.cc:729] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.720431 27520 consensus_queue.cc:260] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.721184 27520 ts_tablet_manager.cc:1398] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.721362 27520 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:08.722046 25944 tablet_service.cc:1467] Processing CreateTablet for tablet adb68aca646d42b2a869eaab1e3e805b (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.722247 27520 tablet_bootstrap.cc:654] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.722276 25944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.723256 27520 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:08.723340 27520 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:08.723821 27520 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.723917 27518 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:08.723956 27520 raft_consensus.cc:374] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.724000 27520 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.724120 27520 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.724408 27520 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.724576 27520 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:08.724720 26076 tablet_service.cc:1467] Processing CreateTablet for tablet cacd9a8959094a24b6f7572e973ef71f (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.724973 26076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.725013 27518 tablet_bootstrap.cc:654] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.725370 27520 tablet_bootstrap.cc:654] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.726102 26339 tablet_service.cc:1467] Processing CreateTablet for tablet d8efe0d8a46e47a59900e07e6430cd37 (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.726092 26471 tablet_service.cc:1467] Processing CreateTablet for tablet d8efe0d8a46e47a59900e07e6430cd37 (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.726137 26077 tablet_service.cc:1467] Processing CreateTablet for tablet adb68aca646d42b2a869eaab1e3e805b (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.726353 26339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8efe0d8a46e47a59900e07e6430cd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.726352 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8efe0d8a46e47a59900e07e6430cd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.726367 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.728485 27524 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:08.728623 26472 tablet_service.cc:1467] Processing CreateTablet for tablet cacd9a8959094a24b6f7572e973ef71f (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.728617 26340 tablet_service.cc:1467] Processing CreateTablet for tablet cacd9a8959094a24b6f7572e973ef71f (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.728837 26340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.728837 26472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.729446 27524 tablet_bootstrap.cc:654] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.729846 26209 tablet_service.cc:1467] Processing CreateTablet for tablet cacd9a8959094a24b6f7572e973ef71f (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.730031 27525 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:08.730145 26209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.730772 27525 tablet_bootstrap.cc:654] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.730792 26473 tablet_service.cc:1467] Processing CreateTablet for tablet adb68aca646d42b2a869eaab1e3e805b (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.731031 26473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.731647 27524 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:08.731768 27524 ts_tablet_manager.cc:1367] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:08.732154 27524 raft_consensus.cc:348] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.732277 27524 raft_consensus.cc:374] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.732319 27524 raft_consensus.cc:729] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.732440 27524 consensus_queue.cc:260] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.732455 26207 tablet_service.cc:1467] Processing CreateTablet for tablet adb68aca646d42b2a869eaab1e3e805b (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.732702 26207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.732911 27525 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:08.733000 27525 ts_tablet_manager.cc:1367] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:47:08.733422 27525 raft_consensus.cc:348] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.733541 27525 raft_consensus.cc:374] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.733577 27525 raft_consensus.cc:729] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.733731 27525 consensus_queue.cc:260] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.733983 27525 ts_tablet_manager.cc:1398] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:08.734022 25943 tablet_service.cc:1467] Processing CreateTablet for tablet cacd9a8959094a24b6f7572e973ef71f (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.734156 27525 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:08.734308 25943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.734752 27524 ts_tablet_manager.cc:1398] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:47:08.734920 26341 tablet_service.cc:1467] Processing CreateTablet for tablet adb68aca646d42b2a869eaab1e3e805b (DEFAULT_TABLE table=rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:08.735158 26341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:08.735886 27525 tablet_bootstrap.cc:654] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.737090 27525 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:08.737171 27525 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:08.737583 27524 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:08.737643 27525 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.737772 27525 raft_consensus.cc:374] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.737824 27525 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.737952 27525 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.738241 27525 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.738402 27525 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:08.738473 27524 tablet_bootstrap.cc:654] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.739269 27525 tablet_bootstrap.cc:654] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.739642 27524 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:08.739763 27524 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:08.740280 27524 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.740427 27524 raft_consensus.cc:374] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.740466 27524 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.740625 27524 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.740727 27525 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:08.740796 27525 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:08.741560 27525 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.741686 27525 raft_consensus.cc:374] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.741727 27525 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.741878 27525 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.742187 27525 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:08.742522 27524 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:47:08.742691 27524 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:08.743155 27517 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:08.744040 27524 tablet_bootstrap.cc:654] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.744072 27517 tablet_bootstrap.cc:654] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.744581 27519 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:08.745553 27519 tablet_bootstrap.cc:654] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.745807 27524 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:08.745926 27524 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:08.746368 27524 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.746557 27524 raft_consensus.cc:374] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.746654 27524 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.746685 27519 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:08.746779 27519 ts_tablet_manager.cc:1367] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:08.746837 27516 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:08.746948 27524 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.747349 27524 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.747579 27519 raft_consensus.cc:348] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.747749 27519 raft_consensus.cc:374] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.747792 27519 raft_consensus.cc:729] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.747910 27516 tablet_bootstrap.cc:654] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.747953 27519 consensus_queue.cc:260] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.748757 27520 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:08.748873 27520 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20240502 20:47:08.749696 27516 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:08.749642 27520 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.749784 27520 raft_consensus.cc:374] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.749794 27516 ts_tablet_manager.cc:1367] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 20:47:08.749825 27520 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.749955 27520 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.750260 27520 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:08.750229 27516 raft_consensus.cc:348] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.750365 27516 raft_consensus.cc:374] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.750399 27516 raft_consensus.cc:729] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.750530 27516 consensus_queue.cc:260] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.750829 27516 ts_tablet_manager.cc:1398] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:08.750831 27519 ts_tablet_manager.cc:1398] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 20:47:08.750988 27516 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:08.751463 27519 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:08.752166 27516 tablet_bootstrap.cc:654] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.752347 27519 tablet_bootstrap.cc:654] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.753144 27517 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:08.753273 27517 ts_tablet_manager.cc:1367] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 20:47:08.753304 27516 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:08.753427 27516 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:08.753669 27518 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:08.753778 27518 ts_tablet_manager.cc:1367] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20240502 20:47:08.753770 27517 raft_consensus.cc:348] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.753819 27516 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.753901 27517 raft_consensus.cc:374] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.753918 27516 raft_consensus.cc:374] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.753937 27517 raft_consensus.cc:729] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.753953 27516 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.754096 27516 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.754091 27517 consensus_queue.cc:260] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.754381 27517 ts_tablet_manager.cc:1398] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.754488 27516 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:08.754551 27517 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:08.754266 27518 raft_consensus.cc:348] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.754900 27518 raft_consensus.cc:374] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.754947 27518 raft_consensus.cc:729] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.755113 27518 consensus_queue.cc:260] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.755439 27516 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:08.755451 27517 tablet_bootstrap.cc:654] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.755684 27518 ts_tablet_manager.cc:1398] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:08.756424 27516 tablet_bootstrap.cc:654] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.756991 27519 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:08.757112 27519 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 20:47:08.757402 27518 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:08.757719 27519 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.757858 27519 raft_consensus.cc:374] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.757850 27504 raft_consensus.cc:482] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:08.757897 27519 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.757951 27504 raft_consensus.cc:504] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.758019 27519 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.758360 27519 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.758548 27519 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:08.758703 27504 leader_election.cc:288] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.759164 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:08.759286 25965 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:08.759438 27519 tablet_bootstrap.cc:654] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.759781 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:08.759788 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:08.759894 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:08.759927 26625 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:08.759927 26491 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:08.759999 26096 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:08.760313 26295 leader_election.cc:302] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 9aaa16c4fc46478f90a3d97b010330c2, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.760627 27517 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:08.760706 27517 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20240502 20:47:08.760780 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:08.760506 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:08.760907 26228 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:08.760946 26755 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:08.761193 27517 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.761323 27517 raft_consensus.cc:374] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.761368 27517 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.761494 27517 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.761835 27517 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:08.762017 27517 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:08.762205 27519 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:08.762238 27518 tablet_bootstrap.cc:654] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.762279 27519 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20240502 20:47:08.762931 27517 tablet_bootstrap.cc:654] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.762916 27504 raft_consensus.cc:2781] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:08.762977 27504 raft_consensus.cc:482] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:08.763016 27504 raft_consensus.cc:3037] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.762974 27519 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.763083 27519 raft_consensus.cc:374] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.763123 27519 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.763269 27519 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.764032 27504 raft_consensus.cc:504] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.764173 27516 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:08.764257 27516 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 20:47:08.764539 27504 leader_election.cc:288] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Requested vote from peers 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.764719 27516 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.764860 27516 raft_consensus.cc:374] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.764899 27516 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.765026 27516 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.765113 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:08.765193 27519 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:47:08.765244 26491 raft_consensus.cc:3037] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.765411 27516 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.766171 26491 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:08.766654 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:08.766745 26228 raft_consensus.cc:3037] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.767637 26228 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:08.768141 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:08.768255 26096 raft_consensus.cc:3037] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.768369 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:08.768484 26755 raft_consensus.cc:3037] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.768496 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:08.768620 26625 raft_consensus.cc:3037] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.769269 26096 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:08.769479 26625 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:08.769505 26755 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:08.769547 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8efe0d8a46e47a59900e07e6430cd37" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:08.769685 25965 raft_consensus.cc:3037] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.769843 26297 leader_election.cc:302] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 6173ed1979b94e509bf1c843a5183690, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.770646 25965 raft_consensus.cc:2454] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:08.771893 27504 raft_consensus.cc:2781] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:08.772004 27504 raft_consensus.cc:686] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Becoming Leader. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Running, Role: LEADER
I20240502 20:47:08.772156 27504 consensus_queue.cc:237] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.774132 27517 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:08.774183 27518 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:08.774240 27517 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20240502 20:47:08.774264 27518 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20240502 20:47:08.774425 25820 catalog_manager.cc:5484] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:08.774711 27517 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.774745 27518 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.774820 27517 raft_consensus.cc:374] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.774837 27518 raft_consensus.cc:374] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.774857 27518 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.774852 27517 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.774964 27518 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.774973 27517 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.775233 27518 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:08.775264 27517 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:08.775427 27518 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:08.776407 27518 tablet_bootstrap.cc:654] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:08.778400 27518 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:08.778499 27518 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:08.778983 27518 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.779130 27518 raft_consensus.cc:374] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:08.779181 27518 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:08.779326 27518 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.779630 27518 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:08.807117 27249 raft_consensus.cc:482] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:08.807257 27249 raft_consensus.cc:504] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.807984 27249 leader_election.cc:288] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.808259 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:08.808418 25965 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:08.808382 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:08.808429 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:08.808522 26625 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:08.808552 26359 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:08.808524 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:08.808667 26228 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:08.808840 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:08.808961 26428 leader_election.cc:302] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 9aaa16c4fc46478f90a3d97b010330c2, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.808990 26096 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:08.809146 27249 raft_consensus.cc:2781] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:08.809137 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:08.809201 27249 raft_consensus.cc:482] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:08.809239 27249 raft_consensus.cc:3037] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.809270 26755 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:08.810256 27249 raft_consensus.cc:504] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.810931 27249 leader_election.cc:288] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 election: Requested vote from peers 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.810988 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:08.811036 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:08.811121 26096 raft_consensus.cc:3037] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.811133 25965 raft_consensus.cc:3037] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.811147 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:08.811264 26359 raft_consensus.cc:3037] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.811322 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:08.811420 26755 raft_consensus.cc:3037] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.812119 25965 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:08.812136 26096 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:08.812320 26359 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:08.812389 26755 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:08.812692 26429 leader_election.cc:302] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.812863 27249 raft_consensus.cc:2781] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:08.812901 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:08.812935 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adb68aca646d42b2a869eaab1e3e805b" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:08.813019 26228 raft_consensus.cc:3037] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.813069 26625 raft_consensus.cc:3037] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.813102 27249 raft_consensus.cc:686] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Becoming Leader. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Running, Role: LEADER
I20240502 20:47:08.813434 27249 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.813938 26625 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:08.813959 26228 raft_consensus.cc:2454] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:08.816401 25820 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133). New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:08.851004 27333 raft_consensus.cc:482] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:08.851141 27333 raft_consensus.cc:504] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.852049 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:08.852102 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:08.852223 26096 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:08.851708 27333 leader_election.cc:288] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.852267 26359 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:08.852356 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:08.852418 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:08.852491 26625 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:08.852552 26491 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:08.852773 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:08.852866 25899 leader_election.cc:302] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:08.852916 26755 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:08.853034 27333 raft_consensus.cc:2781] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:08.853091 27333 raft_consensus.cc:482] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:08.853137 27333 raft_consensus.cc:3037] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.853148 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:08.853286 26228 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 0.
I20240502 20:47:08.854135 27333 raft_consensus.cc:504] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.854820 27333 leader_election.cc:288] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [CANDIDATE]: Term 1 election: Requested vote from peers 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:08.854914 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:08.855026 26096 raft_consensus.cc:3037] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.855051 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:08.855182 26625 raft_consensus.cc:3037] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.855319 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:08.855343 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:08.855437 26491 raft_consensus.cc:3037] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.855443 26359 raft_consensus.cc:3037] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.856047 26096 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:08.856112 26625 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:08.856359 26491 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:08.856359 26359 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:08.856458 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:08.856637 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cacd9a8959094a24b6f7572e973ef71f" candidate_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:08.856598 26228 raft_consensus.cc:3037] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.856771 26755 raft_consensus.cc:3037] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:08.856768 25900 leader_election.cc:302] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2; no voters:
I20240502 20:47:08.856950 27333 raft_consensus.cc:2781] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:08.857172 27333 raft_consensus.cc:686] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Becoming Leader. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Running, Role: LEADER
I20240502 20:47:08.857333 27333 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:08.857741 26755 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:08.857798 26228 raft_consensus.cc:2454] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c6dc91a7df244ab82c1161799ba2ff3 in term 1.
I20240502 20:47:08.859962 25820 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129). New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
W20240502 20:47:08.983441 27549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:08.983702 27549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:08.986863 27549 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_2'
I20240502 20:47:09.071238 26755 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.071627 26625 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.072307 26491 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.072584 26228 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.072620 25965 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.072976 26096 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.073091 27393 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.073437 27393 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.073752 27586 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.074318 27586 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.074802 27393 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.075327 27584 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.076146 25964 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.077212 26096 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.077404 26228 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.078719 27588 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.079264 27590 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.080514 27588 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.080845 26624 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.081290 26625 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.081694 27590 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.082192 26756 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.083230 26360 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.084352 26095 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.085253 26229 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.086241 27545 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.086408 27587 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.088320 26360 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.088876 26492 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.085983 27547 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20240502 20:47:09.108177 27547 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.110321 27333 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.110723 27594 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.111148 27595 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.114205 26755 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.117982 27595 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 227.563 ms
time per row: 0.113781 ms
I20240502 20:47:09.258867 25820 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52614:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:47:09.259411 25820 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_3 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 20:47:09.264978 26605 tablet_service.cc:1467] Processing CreateTablet for tablet 50134092a82f42b08ffacf2eff58b0f9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.265318 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.265323 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 50134092a82f42b08ffacf2eff58b0f9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.265568 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.265607 26077 tablet_service.cc:1467] Processing CreateTablet for tablet 50134092a82f42b08ffacf2eff58b0f9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.265934 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.267980 25943 tablet_service.cc:1467] Processing CreateTablet for tablet 50134092a82f42b08ffacf2eff58b0f9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.268198 27519 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:09.268193 26209 tablet_service.cc:1467] Processing CreateTablet for tablet 51586991cf25422681e1f758f6b7c52d (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.268272 25943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.268385 26208 tablet_service.cc:1467] Processing CreateTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.268455 26209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51586991cf25422681e1f758f6b7c52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.268612 26208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.269119 27519 tablet_bootstrap.cc:654] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.270488 27518 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:09.270563 26076 tablet_service.cc:1467] Processing CreateTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.270839 26076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.268198 26207 tablet_service.cc:1467] Processing CreateTablet for tablet 50134092a82f42b08ffacf2eff58b0f9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.271049 26207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.271286 27518 tablet_bootstrap.cc:654] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.271821 27517 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:09.272612 27517 tablet_bootstrap.cc:654] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.273614 26605 tablet_service.cc:1467] Processing CreateTablet for tablet 51586991cf25422681e1f758f6b7c52d (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.273649 26603 tablet_service.cc:1467] Processing CreateTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.273897 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51586991cf25422681e1f758f6b7c52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.273865 25944 tablet_service.cc:1467] Processing CreateTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.274104 25944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.274121 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.274600 27517 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:09.274700 27517 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:47:09.275179 27517 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.275336 27517 raft_consensus.cc:374] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.275384 27517 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.275507 27517 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.276257 26077 tablet_service.cc:1467] Processing CreateTablet for tablet 51586991cf25422681e1f758f6b7c52d (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.276489 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51586991cf25422681e1f758f6b7c52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.276630 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.276893 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.278194 27517 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:09.278366 27517 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:09.278893 27519 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:09.278993 27519 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20240502 20:47:09.279269 27517 tablet_bootstrap.cc:654] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.279404 27519 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.279528 27519 raft_consensus.cc:374] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.279573 27519 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.279619 26473 tablet_service.cc:1467] Processing CreateTablet for tablet 50134092a82f42b08ffacf2eff58b0f9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.279708 27519 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.279923 26473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.280088 27519 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:09.280290 27519 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:09.280455 27517 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:09.280555 27517 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:09.281194 27519 tablet_bootstrap.cc:654] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.281827 27625 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:09.281970 27517 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.282012 26472 tablet_service.cc:1467] Processing CreateTablet for tablet 51586991cf25422681e1f758f6b7c52d (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.282078 27517 raft_consensus.cc:374] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.282114 27517 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.282235 26472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51586991cf25422681e1f758f6b7c52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.282243 27517 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.282546 27517 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 20:47:09.282775 27625 tablet_bootstrap.cc:654] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.283926 27625 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:09.284016 27625 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:09.284229 26471 tablet_service.cc:1467] Processing CreateTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.284365 27625 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.284461 27625 raft_consensus.cc:374] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.284510 27625 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.284466 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.284675 27625 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.284963 27625 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:09.285110 27625 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:09.286095 26340 tablet_service.cc:1467] Processing CreateTablet for tablet 50134092a82f42b08ffacf2eff58b0f9 (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.286381 26340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.286824 27518 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:09.286927 27518 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20240502 20:47:09.287391 27518 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.287532 27518 raft_consensus.cc:374] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.287569 27518 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.287703 27518 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.288076 27518 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.288033 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 51586991cf25422681e1f758f6b7c52d (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.288224 27518 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:09.288695 26341 tablet_service.cc:1467] Processing CreateTablet for tablet 51586991cf25422681e1f758f6b7c52d (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.288942 26341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51586991cf25422681e1f758f6b7c52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.289104 27518 tablet_bootstrap.cc:654] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.289104 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51586991cf25422681e1f758f6b7c52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.290165 25943 tablet_service.cc:1467] Processing CreateTablet for tablet 51586991cf25422681e1f758f6b7c52d (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.290436 25943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51586991cf25422681e1f758f6b7c52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.291060 26339 tablet_service.cc:1467] Processing CreateTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (DEFAULT_TABLE table=rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.291278 26339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.292521 27517 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:09.293370 27621 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:09.293447 27517 tablet_bootstrap.cc:654] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.293591 27519 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:09.293710 27519 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20240502 20:47:09.293741 27619 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:09.294222 27519 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.294371 27519 raft_consensus.cc:374] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.294412 27519 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.294557 27519 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.294864 27519 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:09.295053 27519 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:09.295162 27517 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:09.295258 27517 ts_tablet_manager.cc:1367] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:09.295763 27517 raft_consensus.cc:348] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.295840 27619 tablet_bootstrap.cc:654] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.295890 27517 raft_consensus.cc:374] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.295933 27517 raft_consensus.cc:729] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.295972 27519 tablet_bootstrap.cc:654] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.296090 27517 consensus_queue.cc:260] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.296415 27517 ts_tablet_manager.cc:1398] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:09.296639 27621 tablet_bootstrap.cc:654] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.297941 27625 tablet_bootstrap.cc:654] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.298228 27519 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:09.298322 27519 ts_tablet_manager.cc:1367] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:47:09.298676 27628 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:09.298841 27519 raft_consensus.cc:348] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.298979 27519 raft_consensus.cc:374] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.299017 27519 raft_consensus.cc:729] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.299157 27519 consensus_queue.cc:260] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.299444 27625 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:09.299481 27519 ts_tablet_manager.cc:1398] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.299620 27625 ts_tablet_manager.cc:1367] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20240502 20:47:09.300165 27625 raft_consensus.cc:348] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.300392 27625 raft_consensus.cc:374] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.300472 27625 raft_consensus.cc:729] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.300683 27625 consensus_queue.cc:260] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.300756 27619 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:09.300848 27619 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20240502 20:47:09.301201 27628 tablet_bootstrap.cc:654] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.301311 27619 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.301684 27625 ts_tablet_manager.cc:1398] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:09.301703 27619 raft_consensus.cc:374] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.301800 27619 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.301949 27619 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.302043 27625 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:09.302428 27518 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:09.302533 27518 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20240502 20:47:09.302601 27619 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:47:09.302778 27619 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:09.302996 27518 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.303107 27518 raft_consensus.cc:374] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.303153 27518 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.303293 27518 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.303547 27518 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.303556 27625 tablet_bootstrap.cc:654] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.303743 27518 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:09.304889 27619 tablet_bootstrap.cc:654] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.305003 27518 tablet_bootstrap.cc:654] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.306234 27518 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:09.306339 27518 ts_tablet_manager.cc:1367] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:09.306803 27518 raft_consensus.cc:348] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.306942 27628 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:09.306953 27518 raft_consensus.cc:374] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.306990 27518 raft_consensus.cc:729] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.307046 27628 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 20:47:09.307126 27518 consensus_queue.cc:260] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.307446 27518 ts_tablet_manager.cc:1398] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.307550 27628 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.307684 27628 raft_consensus.cc:374] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.307752 27628 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.307945 27621 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:09.307891 27628 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.308212 27628 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:09.308342 27619 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:09.308394 27628 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:09.308436 27619 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20240502 20:47:09.308816 27619 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.308918 27619 raft_consensus.cc:374] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.308951 27619 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.309095 27619 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.309356 27619 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:09.309377 27628 tablet_bootstrap.cc:654] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.309522 27619 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:09.310477 27628 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:09.310614 27628 ts_tablet_manager.cc:1367] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:09.310870 27625 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:09.310978 27625 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 20:47:09.311023 27493 raft_consensus.cc:482] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:09.311100 27621 ts_tablet_manager.cc:1367] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20240502 20:47:09.311110 27493 raft_consensus.cc:504] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.311406 27625 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.311517 27625 raft_consensus.cc:374] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.311545 27625 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.311614 27621 raft_consensus.cc:348] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.311776 27621 raft_consensus.cc:374] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.311698 27625 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.311811 27621 raft_consensus.cc:729] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.311996 27625 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.311965 27621 consensus_queue.cc:260] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.312383 27619 tablet_bootstrap.cc:654] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.312885 27493 leader_election.cc:288] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.315976 27628 raft_consensus.cc:348] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.316210 27628 raft_consensus.cc:374] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.316290 27628 raft_consensus.cc:729] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.316474 27628 consensus_queue.cc:260] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.316912 27628 ts_tablet_manager.cc:1398] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20240502 20:47:09.317142 27628 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:09.318528 27628 tablet_bootstrap.cc:654] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.319506 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:09.319630 26359 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.319869 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:09.319995 26491 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.320605 27621 ts_tablet_manager.cc:1398] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20240502 20:47:09.322227 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:09.322369 25962 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.322661 26693 leader_election.cc:302] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:09.322952 27621 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:09.322943 27493 raft_consensus.cc:2781] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:09.323015 27493 raft_consensus.cc:482] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:09.323064 27493 raft_consensus.cc:3037] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.323951 27621 tablet_bootstrap.cc:654] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.325486 27621 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:09.325594 27621 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:09.326021 27621 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.326153 27621 raft_consensus.cc:374] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.326185 27621 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.326339 27621 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.327136 27621 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.327311 27621 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:09.328651 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:09.328900 27621 tablet_bootstrap.cc:654] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
W20240502 20:47:09.329236 26692 leader_election.cc:341] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:47:09.330953 27621 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:09.331037 27621 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240502 20:47:09.331430 27621 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.331550 27621 raft_consensus.cc:374] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.331593 27621 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.331748 27621 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.333554 27621 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:09.335873 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:09.336012 26096 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.337643 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:09.337797 26624 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.348749 27493 raft_consensus.cc:504] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.349545 27493 leader_election.cc:288] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 election: Requested vote from peers 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.349697 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:09.349843 26624 raft_consensus.cc:3037] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.349978 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:09.350054 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:09.350106 26491 raft_consensus.cc:3037] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.350203 25962 raft_consensus.cc:3037] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.350488 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:09.350504 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:09.350625 26359 raft_consensus.cc:3037] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.350630 26096 raft_consensus.cc:3037] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.350682 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50134092a82f42b08ffacf2eff58b0f9" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:09.350812 26228 raft_consensus.cc:3037] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.351569 26228 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.356155 27619 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:09.356271 27619 ts_tablet_manager.cc:1367] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.002s
I20240502 20:47:09.356282 27493 raft_consensus.cc:482] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:09.356427 27493 raft_consensus.cc:504] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.356773 27619 raft_consensus.cc:348] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.356882 27619 raft_consensus.cc:374] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.356922 27619 raft_consensus.cc:729] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.357123 26624 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.357085 27619 consensus_queue.cc:260] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.357161 27493 leader_election.cc:288] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.357417 27619 ts_tablet_manager.cc:1398] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:09.357728 26095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:09.357839 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:09.357889 26095 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.357968 25965 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.358034 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:09.358162 26492 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.358206 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:09.358498 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:09.358629 26624 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
W20240502 20:47:09.358757 26692 leader_election.cc:341] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:47:09.358893 26691 leader_election.cc:302] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 5 responses out of 7 voters: 4 yes votes; 1 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3; no voters: bbee1301f7b94c6ab339ecaccc4ce740
I20240502 20:47:09.359025 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:09.359097 27493 raft_consensus.cc:2781] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:09.359171 27493 raft_consensus.cc:482] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:09.359170 26228 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.359210 27493 raft_consensus.cc:3037] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.360311 27493 raft_consensus.cc:504] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.360939 27493 leader_election.cc:288] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 election: Requested vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.361184 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:09.361194 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:09.361331 26492 raft_consensus.cc:3037] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.361322 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:09.361456 25965 raft_consensus.cc:3037] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.361774 26095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
W20240502 20:47:09.361816 26692 leader_election.cc:341] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:47:09.361894 26095 raft_consensus.cc:3037] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.362140 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:09.362249 26228 raft_consensus.cc:3037] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.363086 26228 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.363458 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51a63a79b0ee42aba9fc7bf8e8c7428e" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:09.363559 26624 raft_consensus.cc:3037] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.364316 26624 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.368683 26491 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.368695 26096 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.368764 26492 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.368765 25962 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.369122 26693 leader_election.cc:302] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, b4908484400a4ce2aea341e9e1bdced3; no voters:
I20240502 20:47:09.369448 27493 raft_consensus.cc:2781] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:09.369765 27493 raft_consensus.cc:686] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Becoming Leader. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Running, Role: LEADER
I20240502 20:47:09.369781 26095 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.369974 26359 raft_consensus.cc:2454] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.369966 25965 raft_consensus.cc:2454] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:09.370178 27493 consensus_queue.cc:237] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.370237 26691 leader_election.cc:302] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 5 responses out of 7 voters: 4 yes votes; 1 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3; no voters: bbee1301f7b94c6ab339ecaccc4ce740
I20240502 20:47:09.370491 27628 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:09.370597 27628 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.000s
I20240502 20:47:09.370980 27654 raft_consensus.cc:2781] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:09.371079 27654 raft_consensus.cc:686] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Becoming Leader. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Running, Role: LEADER
I20240502 20:47:09.371095 27628 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.371243 27628 raft_consensus.cc:374] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.371296 27628 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.371258 27654 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.371479 27628 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.371860 27628 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:09.373735 25815 catalog_manager.cc:5484] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135). New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:09.376894 25815 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135). New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:09.447180 27585 raft_consensus.cc:482] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:09.447340 27585 raft_consensus.cc:504] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.447595 27592 raft_consensus.cc:482] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:09.447743 27592 raft_consensus.cc:504] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.448153 27585 leader_election.cc:288] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.448506 27592 leader_election.cc:288] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.448738 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:09.448773 26095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:09.448894 26624 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.448930 26095 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.448958 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:09.449067 26625 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:09.449333 26095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:09.449354 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:09.449431 26095 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:09.449483 26756 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.449564 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:09.449672 26755 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:09.449779 26297 leader_election.cc:302] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:09.449815 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:09.449882 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:09.449920 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:09.449954 26227 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.450002 26492 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.450039 25962 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.450062 26429 leader_election.cc:302] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3; no voters:
I20240502 20:47:09.450235 27592 raft_consensus.cc:2781] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:09.450287 27592 raft_consensus.cc:482] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:09.450343 27592 raft_consensus.cc:3037] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.450361 27585 raft_consensus.cc:2781] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:09.450412 27585 raft_consensus.cc:482] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:09.450446 27585 raft_consensus.cc:3037] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.450413 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:09.450531 25965 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:09.450726 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:09.450843 26228 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:09.451095 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:09.451426 27592 raft_consensus.cc:504] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.451426 27585 raft_consensus.cc:504] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.451750 26359 raft_consensus.cc:2379] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9aaa16c4fc46478f90a3d97b010330c2 in current term 1: Already voted for candidate bbee1301f7b94c6ab339ecaccc4ce740 in this term.
I20240502 20:47:09.452085 27585 leader_election.cc:288] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Requested vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.452080 27592 leader_election.cc:288] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 election: Requested vote from peers 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.452517 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:09.452569 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:09.452672 26492 raft_consensus.cc:2379] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bbee1301f7b94c6ab339ecaccc4ce740 in current term 1: Already voted for candidate 9aaa16c4fc46478f90a3d97b010330c2 in this term.
I20240502 20:47:09.452674 26625 raft_consensus.cc:3037] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.452806 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:09.452839 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:09.452912 25962 raft_consensus.cc:3037] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.452935 26096 raft_consensus.cc:3037] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.453687 26625 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:09.453799 25962 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:09.453872 26096 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:09.454082 26095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:09.454241 26095 raft_consensus.cc:2379] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bbee1301f7b94c6ab339ecaccc4ce740 in current term 1: Already voted for candidate 9aaa16c4fc46478f90a3d97b010330c2 in this term.
I20240502 20:47:09.454306 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:09.454435 25965 raft_consensus.cc:2379] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9aaa16c4fc46478f90a3d97b010330c2 in current term 1: Already voted for candidate bbee1301f7b94c6ab339ecaccc4ce740 in this term.
I20240502 20:47:09.454471 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:09.454588 26756 raft_consensus.cc:3037] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.454674 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:09.454732 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:09.454846 26227 raft_consensus.cc:3037] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.455292 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:09.455442 26359 raft_consensus.cc:2379] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9aaa16c4fc46478f90a3d97b010330c2 in current term 1: Already voted for candidate bbee1301f7b94c6ab339ecaccc4ce740 in this term.
I20240502 20:47:09.455675 26756 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:09.455688 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:09.455889 26227 raft_consensus.cc:2454] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:09.456024 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51586991cf25422681e1f758f6b7c52d" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:09.456243 26624 raft_consensus.cc:2379] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9aaa16c4fc46478f90a3d97b010330c2 in current term 1: Already voted for candidate bbee1301f7b94c6ab339ecaccc4ce740 in this term.
I20240502 20:47:09.456336 26428 leader_election.cc:302] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 6 responses out of 7 voters: 4 yes votes; 2 no votes. yes voters: 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3; no voters: 3c6dc91a7df244ab82c1161799ba2ff3, bbee1301f7b94c6ab339ecaccc4ce740
I20240502 20:47:09.456331 26296 leader_election.cc:302] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 7 responses out of 7 voters: 3 yes votes; 4 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, bbee1301f7b94c6ab339ecaccc4ce740; no voters: 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3
I20240502 20:47:09.456499 27585 raft_consensus.cc:2726] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240502 20:47:09.456672 27592 raft_consensus.cc:2781] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:09.456769 27592 raft_consensus.cc:686] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Becoming Leader. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Running, Role: LEADER
I20240502 20:47:09.456924 27592 consensus_queue.cc:237] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.459347 25815 catalog_manager.cc:5484] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133). New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
W20240502 20:47:09.583321 27658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:09.583604 27658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:09.587034 27658 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_3'
I20240502 20:47:09.684708 26227 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.685500 25962 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.685712 26095 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.686002 27654 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.686134 26624 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.686714 25965 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.687062 26756 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.692678 26359 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.692656 27592 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.693724 26227 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.693765 26359 raft_consensus.cc:3037] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.695062 26359 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.695225 27587 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.695655 27587 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.695967 27587 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.696424 27688 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.698104 27688 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.698325 26492 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.704615 26094 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.704996 27493 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.705369 26624 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.705380 27493 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.706317 26095 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.708992 27654 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.709359 27654 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.709609 27654 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.714007 25964 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.715752 27493 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.723343 27653 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.746410 26361 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.747159 27493 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.747635 26228 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.747957 26624 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.752560 26492 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:09.753343 27654 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.753677 27654 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.754374 27653 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:09.763929 27496 mvcc.cc:205] Tried to move back new op lower bound from 7023340870380142592 to 7023340869458714624. Current Snapshot: MvccSnapshot[applied={T|T < 7023340870380142592}]
I20240502 20:47:09.783280 27343 mvcc.cc:205] Tried to move back new op lower bound from 7023340870656331776 to 7023340869099499520. Current Snapshot: MvccSnapshot[applied={T|T < 7023340870376599552}]
I20240502 20:47:09.813748 27701 mvcc.cc:205] Tried to move back new op lower bound from 7023340870656331776 to 7023340869099499520. Current Snapshot: MvccSnapshot[applied={T|T < 7023340870376599552}]
I20240502 20:47:09.826347 27708 mvcc.cc:205] Tried to move back new op lower bound from 7023340870656331776 to 7023340869099499520. Current Snapshot: MvccSnapshot[applied={T|T < 7023340870656331776}]
INSERT report
rows total: 2000
time total: 207.487 ms
time per row: 0.103743 ms
I20240502 20:47:09.848644 25815 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52614:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:47:09.849184 25815 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_4 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 20:47:09.856626 26339 tablet_service.cc:1467] Processing CreateTablet for tablet 00bf11a3e1c24449bba6a09d4ab280b0 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.856920 26339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bf11a3e1c24449bba6a09d4ab280b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.857205 26077 tablet_service.cc:1467] Processing CreateTablet for tablet 00bf11a3e1c24449bba6a09d4ab280b0 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.857491 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bf11a3e1c24449bba6a09d4ab280b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.858989 26605 tablet_service.cc:1467] Processing CreateTablet for tablet 00bf11a3e1c24449bba6a09d4ab280b0 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.859267 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bf11a3e1c24449bba6a09d4ab280b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.859258 26736 tablet_service.cc:1467] Processing CreateTablet for tablet d19c2fce372b4bbb936013051cc32978 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.859256 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 00bf11a3e1c24449bba6a09d4ab280b0 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.859567 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d19c2fce372b4bbb936013051cc32978. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.859927 27628 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:09.859978 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bf11a3e1c24449bba6a09d4ab280b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.860333 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 441da21c8ff8492c88c752ebf1233857 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.860529 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441da21c8ff8492c88c752ebf1233857. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.860805 27628 tablet_bootstrap.cc:654] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.862608 25943 tablet_service.cc:1467] Processing CreateTablet for tablet 00bf11a3e1c24449bba6a09d4ab280b0 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.862774 26471 tablet_service.cc:1467] Processing CreateTablet for tablet 00bf11a3e1c24449bba6a09d4ab280b0 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.862881 25943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bf11a3e1c24449bba6a09d4ab280b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.862954 26341 tablet_service.cc:1467] Processing CreateTablet for tablet 441da21c8ff8492c88c752ebf1233857 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.863031 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bf11a3e1c24449bba6a09d4ab280b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.863176 26341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441da21c8ff8492c88c752ebf1233857. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.863960 25944 tablet_service.cc:1467] Processing CreateTablet for tablet d19c2fce372b4bbb936013051cc32978 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.864166 25944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d19c2fce372b4bbb936013051cc32978. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.865293 26472 tablet_service.cc:1467] Processing CreateTablet for tablet d19c2fce372b4bbb936013051cc32978 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.865512 26472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d19c2fce372b4bbb936013051cc32978. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.866282 25945 tablet_service.cc:1467] Processing CreateTablet for tablet 441da21c8ff8492c88c752ebf1233857 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.866492 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441da21c8ff8492c88c752ebf1233857. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.867476 26473 tablet_service.cc:1467] Processing CreateTablet for tablet 441da21c8ff8492c88c752ebf1233857 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.867707 26473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441da21c8ff8492c88c752ebf1233857. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.867669 26339 tablet_service.cc:1467] Processing CreateTablet for tablet d19c2fce372b4bbb936013051cc32978 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.867959 26339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d19c2fce372b4bbb936013051cc32978. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.868757 26207 tablet_service.cc:1467] Processing CreateTablet for tablet 00bf11a3e1c24449bba6a09d4ab280b0 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.869015 26207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bf11a3e1c24449bba6a09d4ab280b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.871145 27743 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:09.871301 26209 tablet_service.cc:1467] Processing CreateTablet for tablet d19c2fce372b4bbb936013051cc32978 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.871521 26209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d19c2fce372b4bbb936013051cc32978. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.872107 27743 tablet_bootstrap.cc:654] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.872506 27628 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:09.872591 27628 ts_tablet_manager.cc:1367] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 20:47:09.873087 27628 raft_consensus.cc:348] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.873250 27628 raft_consensus.cc:374] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.873284 27628 raft_consensus.cc:729] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.873412 27628 consensus_queue.cc:260] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.873611 26208 tablet_service.cc:1467] Processing CreateTablet for tablet 441da21c8ff8492c88c752ebf1233857 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.873718 27628 ts_tablet_manager.cc:1398] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.873845 26208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441da21c8ff8492c88c752ebf1233857. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.873917 27628 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:09.874950 27628 tablet_bootstrap.cc:654] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.877147 26077 tablet_service.cc:1467] Processing CreateTablet for tablet d19c2fce372b4bbb936013051cc32978 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.877269 27739 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:09.877147 26076 tablet_service.cc:1467] Processing CreateTablet for tablet 441da21c8ff8492c88c752ebf1233857 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.877426 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d19c2fce372b4bbb936013051cc32978. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.877445 26605 tablet_service.cc:1467] Processing CreateTablet for tablet d19c2fce372b4bbb936013051cc32978 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.877604 26076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441da21c8ff8492c88c752ebf1233857. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.877686 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d19c2fce372b4bbb936013051cc32978. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.878116 27739 tablet_bootstrap.cc:654] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.879854 26603 tablet_service.cc:1467] Processing CreateTablet for tablet 441da21c8ff8492c88c752ebf1233857 (DEFAULT_TABLE table=rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:09.880028 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441da21c8ff8492c88c752ebf1233857. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:09.883289 27741 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:09.883955 27737 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:09.884189 27741 tablet_bootstrap.cc:654] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.884771 27737 tablet_bootstrap.cc:654] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.885285 27739 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:09.885285 27741 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:09.885365 27739 ts_tablet_manager.cc:1367] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 20:47:09.885365 27741 ts_tablet_manager.cc:1367] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:09.885785 27739 raft_consensus.cc:348] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.885785 27741 raft_consensus.cc:348] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.885908 27741 raft_consensus.cc:374] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.885908 27739 raft_consensus.cc:374] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.885942 27741 raft_consensus.cc:729] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.885942 27739 raft_consensus.cc:729] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.886087 27739 consensus_queue.cc:260] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.886086 27741 consensus_queue.cc:260] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.886363 27742 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:09.886898 27739 ts_tablet_manager.cc:1398] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.887084 27739 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:09.887127 27742 tablet_bootstrap.cc:654] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.888203 27741 ts_tablet_manager.cc:1398] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:47:09.888362 27739 tablet_bootstrap.cc:654] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.888389 27741 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:09.889286 27741 tablet_bootstrap.cc:654] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.889740 27739 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:09.889815 27739 ts_tablet_manager.cc:1367] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:47:09.889919 27737 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:09.889954 27740 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:09.890002 27737 ts_tablet_manager.cc:1367] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 20:47:09.890257 27712 raft_consensus.cc:482] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:09.890276 27739 raft_consensus.cc:348] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.890391 27739 raft_consensus.cc:374] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.890344 27712 raft_consensus.cc:504] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.890419 27739 raft_consensus.cc:729] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.890600 27739 consensus_queue.cc:260] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.890833 27740 tablet_bootstrap.cc:654] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.890918 27739 ts_tablet_manager.cc:1398] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.891047 27712 leader_election.cc:288] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.891053 27739 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:09.891705 27742 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:09.891846 27742 ts_tablet_manager.cc:1367] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 20:47:09.892040 27739 tablet_bootstrap.cc:654] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.892206 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:09.892282 27742 raft_consensus.cc:348] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.892509 27742 raft_consensus.cc:374] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.892586 27742 raft_consensus.cc:729] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
W20240502 20:47:09.892889 26691 leader_election.cc:341] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:47:09.892431 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:09.893365 27628 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:09.893466 27628 ts_tablet_manager.cc:1367] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
W20240502 20:47:09.893445 26691 leader_election.cc:341] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:47:09.893724 27742 consensus_queue.cc:260] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.893785 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:09.893884 27628 raft_consensus.cc:348] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.894001 27628 raft_consensus.cc:374] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.894026 27628 raft_consensus.cc:729] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.894153 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:09.894179 27628 consensus_queue.cc:260] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.894529 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:09.894883 27742 ts_tablet_manager.cc:1398] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240502 20:47:09.895030 27628 ts_tablet_manager.cc:1398] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:09.895154 27742 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:09.895196 27628 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:09.896003 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:09.896152 25965 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:09.896775 27741 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:09.896920 27741 ts_tablet_manager.cc:1367] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
W20240502 20:47:09.897917 26692 leader_election.cc:341] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463): Illegal state: must be running to vote when last-logged opid is not known
W20240502 20:47:09.898049 26692 leader_election.cc:341] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:47:09.897927 27741 raft_consensus.cc:348] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.898105 26692 leader_election.cc:302] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 7 voters: 1 yes votes; 4 no votes. yes voters: b4908484400a4ce2aea341e9e1bdced3; no voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2
I20240502 20:47:09.898208 27741 raft_consensus.cc:374] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20240502 20:47:09.898283 26692 leader_election.cc:341] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:47:09.898303 27741 raft_consensus.cc:729] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.898542 27741 consensus_queue.cc:260] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.899012 27741 ts_tablet_manager.cc:1398] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:09.896081 27742 tablet_bootstrap.cc:654] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.899820 27712 raft_consensus.cc:2726] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 20:47:09.901939 27741 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:09.903479 27737 raft_consensus.cc:348] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.903638 27737 raft_consensus.cc:374] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.903677 27737 raft_consensus.cc:729] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.903988 27628 tablet_bootstrap.cc:654] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.904011 27740 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:09.904222 27740 ts_tablet_manager.cc:1367] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20240502 20:47:09.904292 27737 consensus_queue.cc:260] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.904707 27737 ts_tablet_manager.cc:1398] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20240502 20:47:09.904927 27737 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:09.904884 27740 raft_consensus.cc:348] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.905114 27740 raft_consensus.cc:374] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.905189 27740 raft_consensus.cc:729] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.905408 27740 consensus_queue.cc:260] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.905776 27740 ts_tablet_manager.cc:1398] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.905903 27737 tablet_bootstrap.cc:654] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.906590 27740 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:09.908280 27740 tablet_bootstrap.cc:654] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.908754 27741 tablet_bootstrap.cc:654] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.910630 27743 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:09.910749 27743 ts_tablet_manager.cc:1367] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20240502 20:47:09.911262 27743 raft_consensus.cc:348] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.911401 27743 raft_consensus.cc:374] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.911439 27743 raft_consensus.cc:729] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.911581 27743 consensus_queue.cc:260] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.911947 27743 ts_tablet_manager.cc:1398] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.912076 27739 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:09.912127 27743 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:09.912160 27739 ts_tablet_manager.cc:1367] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20240502 20:47:09.912273 27737 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:09.912353 27737 ts_tablet_manager.cc:1367] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 20:47:09.912555 27739 raft_consensus.cc:348] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.912670 27739 raft_consensus.cc:374] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.912695 27739 raft_consensus.cc:729] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.912775 27737 raft_consensus.cc:348] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.912838 27739 consensus_queue.cc:260] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.912885 27737 raft_consensus.cc:374] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.912927 27737 raft_consensus.cc:729] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.913014 27743 tablet_bootstrap.cc:654] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.913069 27737 consensus_queue.cc:260] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.913394 27737 ts_tablet_manager.cc:1398] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.913542 27739 ts_tablet_manager.cc:1398] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:09.913594 27737 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:09.914453 27737 tablet_bootstrap.cc:654] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.915693 27742 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:09.917701 27742 ts_tablet_manager.cc:1367] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.001s
I20240502 20:47:09.918308 27628 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:09.918409 27628 ts_tablet_manager.cc:1367] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20240502 20:47:09.918601 27742 raft_consensus.cc:348] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.918833 27742 raft_consensus.cc:374] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.918843 27628 raft_consensus.cc:348] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.918977 27628 raft_consensus.cc:374] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.919011 27628 raft_consensus.cc:729] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.918929 27742 raft_consensus.cc:729] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.919128 27628 consensus_queue.cc:260] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.919271 27742 consensus_queue.cc:260] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.919378 27628 ts_tablet_manager.cc:1398] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.920006 27742 ts_tablet_manager.cc:1398] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:09.920218 27742 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:09.921181 27742 tablet_bootstrap.cc:654] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.922991 27740 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:09.923157 27740 ts_tablet_manager.cc:1367] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20240502 20:47:09.923660 27740 raft_consensus.cc:348] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.923945 27740 raft_consensus.cc:374] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.924036 27740 raft_consensus.cc:729] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.924283 27585 raft_consensus.cc:482] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:09.924258 27740 consensus_queue.cc:260] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.924383 27585 raft_consensus.cc:504] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.925040 27585 leader_election.cc:288] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:09.925290 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:09.925302 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:09.925544 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:09.925686 25965 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
W20240502 20:47:09.925719 26295 leader_election.cc:341] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445): Illegal state: must be running to vote when last-logged opid is not known
W20240502 20:47:09.925892 26295 leader_election.cc:341] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:47:09.926040 27740 ts_tablet_manager.cc:1398] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240502 20:47:09.926358 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:09.926466 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:09.926503 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:09.926617 26756 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
W20240502 20:47:09.926698 26296 leader_election.cc:341] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463): Illegal state: must be running to vote when last-logged opid is not known
W20240502 20:47:09.926800 26296 leader_election.cc:341] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495): Illegal state: must be running to vote when last-logged opid is not known
I20240502 20:47:09.926842 26296 leader_election.cc:302] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 6 responses out of 7 voters: 2 yes votes; 4 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, bbee1301f7b94c6ab339ecaccc4ce740; no voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2
I20240502 20:47:09.927076 27740 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:09.927237 27585 raft_consensus.cc:2726] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 20:47:09.928225 27740 tablet_bootstrap.cc:654] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.929365 27741 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:09.929425 27740 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:09.929481 27741 ts_tablet_manager.cc:1367] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20240502 20:47:09.929605 27740 ts_tablet_manager.cc:1367] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 20:47:09.929988 27741 raft_consensus.cc:348] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.930024 27740 raft_consensus.cc:348] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.930114 27741 raft_consensus.cc:374] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.930150 27741 raft_consensus.cc:729] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.930148 27740 raft_consensus.cc:374] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.930186 27740 raft_consensus.cc:729] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.930313 27740 consensus_queue.cc:260] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.930330 27741 consensus_queue.cc:260] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.930583 27740 ts_tablet_manager.cc:1398] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:09.931177 27741 ts_tablet_manager.cc:1398] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:09.932144 27737 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:09.932242 27737 ts_tablet_manager.cc:1367] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20240502 20:47:09.932301 27742 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:09.932732 27737 raft_consensus.cc:348] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.932852 27737 raft_consensus.cc:374] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.932400 27742 ts_tablet_manager.cc:1367] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20240502 20:47:09.932878 27737 raft_consensus.cc:729] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.932994 27737 consensus_queue.cc:260] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.933794 27737 ts_tablet_manager.cc:1398] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:09.933351 27742 raft_consensus.cc:348] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.934916 27742 raft_consensus.cc:374] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.934976 27742 raft_consensus.cc:729] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.935132 27742 consensus_queue.cc:260] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.935580 27742 ts_tablet_manager.cc:1398] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 20:47:09.952205 27743 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:09.952322 27743 ts_tablet_manager.cc:1367] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20240502 20:47:09.952826 27743 raft_consensus.cc:348] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.952973 27743 raft_consensus.cc:374] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.952996 27743 raft_consensus.cc:729] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.953135 27743 consensus_queue.cc:260] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.953434 27743 ts_tablet_manager.cc:1398] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:09.953621 27743 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:09.954670 27743 tablet_bootstrap.cc:654] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:09.955814 27743 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:09.955909 27743 ts_tablet_manager.cc:1367] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:09.956269 27743 raft_consensus.cc:348] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.956378 27743 raft_consensus.cc:374] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:09.956415 27743 raft_consensus.cc:729] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:09.956574 27743 consensus_queue.cc:260] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.956851 27743 ts_tablet_manager.cc:1398] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:09.968914 27474 raft_consensus.cc:482] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:09.969074 27474 raft_consensus.cc:504] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.969837 27474 leader_election.cc:288] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:09.970125 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:09.970281 26624 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:09.970345 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:09.970415 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:09.970474 26756 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:09.970657 26228 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:09.970744 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:09.970883 25965 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:09.971074 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:09.971130 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:09.971210 26492 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:09.971256 26359 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:09.971313 26033 leader_election.cc:302] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3; no voters:
I20240502 20:47:09.971520 27474 raft_consensus.cc:2781] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:09.971580 27474 raft_consensus.cc:482] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:09.971617 27474 raft_consensus.cc:3037] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.972671 27474 raft_consensus.cc:504] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.972968 27585 raft_consensus.cc:482] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:09.973086 27585 raft_consensus.cc:504] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.973373 27474 leader_election.cc:288] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Requested vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:09.973842 27585 leader_election.cc:288] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.973834 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:09.973968 26756 raft_consensus.cc:3037] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.974270 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:09.974392 26625 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.974454 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:09.974522 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:09.974570 25965 raft_consensus.cc:3037] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.974622 26359 raft_consensus.cc:3037] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.974963 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:09.975075 26755 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.975093 26756 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:09.975498 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:09.975631 26228 raft_consensus.cc:3037] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.975647 25965 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:09.975656 26359 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:09.975919 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:09.976043 26094 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.976030 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:09.976078 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441da21c8ff8492c88c752ebf1233857" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:09.976141 26624 raft_consensus.cc:3037] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.976205 26491 raft_consensus.cc:3037] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.977088 26624 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:09.977088 26491 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:09.977380 26228 raft_consensus.cc:2454] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:09.977511 26295 leader_election.cc:302] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:09.977638 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:09.977741 27585 raft_consensus.cc:2781] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:09.977761 26492 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.977795 27585 raft_consensus.cc:482] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:09.977833 27585 raft_consensus.cc:3037] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.977828 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:09.977937 26228 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.978094 26033 leader_election.cc:302] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:09.978274 27474 raft_consensus.cc:2781] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:09.978436 27474 raft_consensus.cc:686] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Becoming Leader. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Running, Role: LEADER
I20240502 20:47:09.978518 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:09.978626 25965 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:09.978641 27474 consensus_queue.cc:237] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:09.978878 27585 raft_consensus.cc:504] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.979571 27585 leader_election.cc:288] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Requested vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:09.979800 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:09.979935 26624 raft_consensus.cc:3037] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.980149 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:09.980134 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:09.980258 26094 raft_consensus.cc:3037] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.980270 26756 raft_consensus.cc:3037] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.980909 26624 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:09.981280 26756 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:09.981880 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:09.982005 25965 raft_consensus.cc:3037] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.982147 26094 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:09.982381 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:09.982352 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c2fce372b4bbb936013051cc32978" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:09.982484 26228 raft_consensus.cc:3037] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.982501 26492 raft_consensus.cc:3037] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:09.983013 25965 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:09.983248 26295 leader_election.cc:302] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:09.983219 25821 catalog_manager.cc:5484] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73a41df730ef429d84fe648df03a2701 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:09.983526 26228 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:09.983932 26492 raft_consensus.cc:2454] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:09.984051 27585 raft_consensus.cc:2781] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:09.984225 27585 raft_consensus.cc:686] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Becoming Leader. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Running, Role: LEADER
I20240502 20:47:09.984405 27585 consensus_queue.cc:237] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:09.986528 25821 catalog_manager.cc:5484] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:10.004180 27499 raft_consensus.cc:482] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:10.004328 27499 raft_consensus.cc:504] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.005743 27499 leader_election.cc:288] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129)
I20240502 20:47:10.011371 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:10.011488 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:10.011559 26359 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.011613 26492 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.011760 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:10.011929 25965 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.012256 26165 leader_election.cc:302] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 6173ed1979b94e509bf1c843a5183690, 9aaa16c4fc46478f90a3d97b010330c2, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:10.012506 27499 raft_consensus.cc:2781] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:10.012553 27499 raft_consensus.cc:482] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:10.012589 27499 raft_consensus.cc:3037] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.013468 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:10.013603 26756 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.014048 27499 raft_consensus.cc:504] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.014592 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:10.014665 27499 leader_election.cc:288] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [CANDIDATE]: Term 1 election: Requested vote from peers bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129)
I20240502 20:47:10.014736 26624 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.014875 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:10.014909 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:10.014990 26492 raft_consensus.cc:3037] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.015010 26359 raft_consensus.cc:3037] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.015369 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:10.015475 26756 raft_consensus.cc:3037] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.015971 26492 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.016019 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:10.016081 26359 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.016117 26624 raft_consensus.cc:3037] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.016461 26756 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.016852 26165 leader_election.cc:302] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 6173ed1979b94e509bf1c843a5183690, 9aaa16c4fc46478f90a3d97b010330c2, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:10.016832 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:10.016979 25965 raft_consensus.cc:3037] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.017055 27499 raft_consensus.cc:2781] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:10.017109 26624 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.017314 27499 raft_consensus.cc:686] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Becoming Leader. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Running, Role: LEADER
I20240502 20:47:10.017683 27499 consensus_queue.cc:237] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.017782 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:10.017915 26096 raft_consensus.cc:3037] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.018009 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bf11a3e1c24449bba6a09d4ab280b0" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:10.018054 25965 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.018908 26096 raft_consensus.cc:2454] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.020831 25821 catalog_manager.cc:5484] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6173ed1979b94e509bf1c843a5183690 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } }
W20240502 20:47:10.179579 27779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:10.179952 27779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:10.183550 27779 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_4'
I20240502 20:47:10.275161 26756 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.275575 27476 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.277110 26492 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.277496 26359 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.277536 27476 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.279294 27476 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.281216 25965 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.281216 25962 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.281939 26624 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.282199 27777 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.282882 27476 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.283156 26228 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.283177 27476 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.283571 27476 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.286337 26624 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.286929 27765 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.288147 25964 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.291344 26755 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.292318 26094 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.283201 26096 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.292637 26491 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.292853 27585 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.293277 26228 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.293278 27585 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.294562 27499 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.294929 27765 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.295935 27585 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.296198 27585 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.301147 26493 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.301489 26361 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.302141 26625 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.303086 26755 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.304224 27826 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.306757 27777 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.307083 27777 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.307408 27777 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.308831 27353 mvcc.cc:205] Tried to move back new op lower bound from 7023340872800153600 to 7023340871595741184. Current Snapshot: MvccSnapshot[applied={T|T < 7023340872800153600}]
I20240502 20:47:10.309250 27699 mvcc.cc:205] Tried to move back new op lower bound from 7023340872800153600 to 7023340871595741184. Current Snapshot: MvccSnapshot[applied={T|T < 7023340872800153600}]
I20240502 20:47:10.348914 27332 mvcc.cc:205] Tried to move back new op lower bound from 7023340872800153600 to 7023340871595741184. Current Snapshot: MvccSnapshot[applied={T|T < 7023340872800153600}]
INSERT report
rows total: 2000
time total: 204.463 ms
time per row: 0.102232 ms
I20240502 20:47:10.443693 25814 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52614:
name: "rebalance_test_table_5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:47:10.444305 25814 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_5 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 20:47:10.449986 26077 tablet_service.cc:1467] Processing CreateTablet for tablet 679352ffb9884583a0f1ee092d4badb1 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.450314 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.450438 26208 tablet_service.cc:1467] Processing CreateTablet for tablet 679352ffb9884583a0f1ee092d4badb1 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.450729 26208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.452917 27743 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:10.453172 25943 tablet_service.cc:1467] Processing CreateTablet for tablet 679352ffb9884583a0f1ee092d4badb1 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.453176 26339 tablet_service.cc:1467] Processing CreateTablet for tablet 679352ffb9884583a0f1ee092d4badb1 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.453545 26339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.453545 25943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.453766 27743 tablet_bootstrap.cc:654] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.454317 27854 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:10.455183 27854 tablet_bootstrap.cc:654] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.455911 25945 tablet_service.cc:1467] Processing CreateTablet for tablet f9f56f646f94461ab85acea3efdc14f4 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.456192 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f56f646f94461ab85acea3efdc14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.456317 27854 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:10.456399 27854 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 20:47:10.456981 27854 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.457140 27854 raft_consensus.cc:374] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.457172 27854 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.457106 26473 tablet_service.cc:1467] Processing CreateTablet for tablet 679352ffb9884583a0f1ee092d4badb1 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.457312 27854 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.457399 26473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.457571 27854 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:10.458371 25944 tablet_service.cc:1467] Processing CreateTablet for tablet 406675832bd84f4ea6de10c0ae14ec53 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.458621 25944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 406675832bd84f4ea6de10c0ae14ec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.459933 26472 tablet_service.cc:1467] Processing CreateTablet for tablet f9f56f646f94461ab85acea3efdc14f4 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.460204 26472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f56f646f94461ab85acea3efdc14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.460860 26737 tablet_service.cc:1467] Processing CreateTablet for tablet 679352ffb9884583a0f1ee092d4badb1 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.461145 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.462350 26471 tablet_service.cc:1467] Processing CreateTablet for tablet 406675832bd84f4ea6de10c0ae14ec53 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.462587 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 406675832bd84f4ea6de10c0ae14ec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.463443 27860 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:10.463631 26735 tablet_service.cc:1467] Processing CreateTablet for tablet f9f56f646f94461ab85acea3efdc14f4 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.463907 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f56f646f94461ab85acea3efdc14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.464228 27860 tablet_bootstrap.cc:654] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.465175 27860 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:10.465279 27860 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:10.465230 26341 tablet_service.cc:1467] Processing CreateTablet for tablet 406675832bd84f4ea6de10c0ae14ec53 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.465500 26341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 406675832bd84f4ea6de10c0ae14ec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.465801 27860 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.465909 27860 raft_consensus.cc:374] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.465942 27860 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.466059 27860 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.466204 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 406675832bd84f4ea6de10c0ae14ec53 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.466359 27860 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:10.466472 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 406675832bd84f4ea6de10c0ae14ec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.466532 27860 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:10.467594 27860 tablet_bootstrap.cc:654] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.468389 26209 tablet_service.cc:1467] Processing CreateTablet for tablet 406675832bd84f4ea6de10c0ae14ec53 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.468690 26209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 406675832bd84f4ea6de10c0ae14ec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.468844 26077 tablet_service.cc:1467] Processing CreateTablet for tablet f9f56f646f94461ab85acea3efdc14f4 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.469163 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f56f646f94461ab85acea3efdc14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.469113 26603 tablet_service.cc:1467] Processing CreateTablet for tablet 679352ffb9884583a0f1ee092d4badb1 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.469362 26603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.470862 27854 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:10.471025 26076 tablet_service.cc:1467] Processing CreateTablet for tablet 406675832bd84f4ea6de10c0ae14ec53 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.471233 26076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 406675832bd84f4ea6de10c0ae14ec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.471791 27854 tablet_bootstrap.cc:654] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.471877 26605 tablet_service.cc:1467] Processing CreateTablet for tablet f9f56f646f94461ab85acea3efdc14f4 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.472110 26605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f56f646f94461ab85acea3efdc14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.472179 26339 tablet_service.cc:1467] Processing CreateTablet for tablet f9f56f646f94461ab85acea3efdc14f4 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.472422 26339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f56f646f94461ab85acea3efdc14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.472872 27854 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:10.472951 27854 ts_tablet_manager.cc:1367] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 20:47:10.472950 26208 tablet_service.cc:1467] Processing CreateTablet for tablet f9f56f646f94461ab85acea3efdc14f4 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.473199 26208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f56f646f94461ab85acea3efdc14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.473436 27854 raft_consensus.cc:348] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.473572 27854 raft_consensus.cc:374] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.473613 27854 raft_consensus.cc:729] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.473758 27854 consensus_queue.cc:260] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.474114 27854 ts_tablet_manager.cc:1398] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:10.474227 27860 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:10.474279 27854 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:10.474220 26604 tablet_service.cc:1467] Processing CreateTablet for tablet 406675832bd84f4ea6de10c0ae14ec53 (DEFAULT_TABLE table=rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.474323 27860 ts_tablet_manager.cc:1367] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20240502 20:47:10.474462 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 406675832bd84f4ea6de10c0ae14ec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.474792 27860 raft_consensus.cc:348] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.474905 27860 raft_consensus.cc:374] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.474937 27860 raft_consensus.cc:729] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.475047 27860 consensus_queue.cc:260] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.475142 27854 tablet_bootstrap.cc:654] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.475387 27860 ts_tablet_manager.cc:1398] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:10.477697 27863 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:10.478698 27863 tablet_bootstrap.cc:654] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.479471 27859 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:10.479684 27854 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:10.479818 27854 ts_tablet_manager.cc:1367] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20240502 20:47:10.480185 27854 raft_consensus.cc:348] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.480288 27854 raft_consensus.cc:374] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.480309 27854 raft_consensus.cc:729] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.480433 27854 consensus_queue.cc:260] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.480710 27854 ts_tablet_manager.cc:1398] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:10.480810 27860 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:10.480832 27859 tablet_bootstrap.cc:654] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.481822 27860 tablet_bootstrap.cc:654] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.482056 27859 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:10.482158 27859 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:10.482688 27859 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.482836 27859 raft_consensus.cc:374] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.482827 27856 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:10.482875 27859 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.482993 27859 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.483044 27860 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:10.483134 27860 ts_tablet_manager.cc:1367] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 20:47:10.483613 27860 raft_consensus.cc:348] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.483716 27860 raft_consensus.cc:374] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.483788 27860 raft_consensus.cc:729] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.483875 27856 tablet_bootstrap.cc:654] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.483912 27860 consensus_queue.cc:260] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.484176 27860 ts_tablet_manager.cc:1398] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:10.484946 27857 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:10.485231 27859 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:47:10.485404 27859 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:10.485596 27743 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:10.485692 27743 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20240502 20:47:10.486205 27857 tablet_bootstrap.cc:654] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.486205 27859 tablet_bootstrap.cc:654] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.486150 27743 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.486285 27743 raft_consensus.cc:374] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.486332 27743 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.486461 27743 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.486765 27743 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:10.486927 27743 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:10.487246 27856 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:10.487335 27856 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20240502 20:47:10.487852 27743 tablet_bootstrap.cc:654] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.487812 27856 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.487932 27856 raft_consensus.cc:374] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.487975 27856 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.488119 27856 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.488940 27856 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:10.489120 27856 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:10.489526 27863 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:10.489687 27863 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20240502 20:47:10.489956 27856 tablet_bootstrap.cc:654] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.490375 27863 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.490562 27863 raft_consensus.cc:374] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.490648 27863 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.490854 27863 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.491037 27857 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:10.491153 27857 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:47:10.491328 27863 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:10.491482 27863 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:10.491632 27857 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.491793 27857 raft_consensus.cc:374] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.491833 27857 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.492031 27857 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.492395 27857 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:10.492447 27863 tablet_bootstrap.cc:654] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.492600 27857 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:10.493656 27857 tablet_bootstrap.cc:654] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.493804 27743 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:10.493901 27743 ts_tablet_manager.cc:1367] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20240502 20:47:10.494325 27743 raft_consensus.cc:348] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.494446 27743 raft_consensus.cc:374] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.494482 27743 raft_consensus.cc:729] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.494606 27743 consensus_queue.cc:260] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.494913 27743 ts_tablet_manager.cc:1398] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:10.495056 27857 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:10.495077 27743 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:10.495142 27857 ts_tablet_manager.cc:1367] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:10.495553 27857 raft_consensus.cc:348] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.495682 27857 raft_consensus.cc:374] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.495715 27857 raft_consensus.cc:729] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.495873 27856 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:10.495965 27856 ts_tablet_manager.cc:1367] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20240502 20:47:10.495931 27857 consensus_queue.cc:260] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.496188 27857 ts_tablet_manager.cc:1398] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:10.496335 27857 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:10.496408 27856 raft_consensus.cc:348] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.496546 27856 raft_consensus.cc:374] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.496580 27856 raft_consensus.cc:729] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.496721 27856 consensus_queue.cc:260] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.496948 27743 tablet_bootstrap.cc:654] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.497126 27856 ts_tablet_manager.cc:1398] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:10.497220 27857 tablet_bootstrap.cc:654] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.497300 27856 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:10.498073 27863 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:10.498172 27863 ts_tablet_manager.cc:1367] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 20:47:10.498205 27856 tablet_bootstrap.cc:654] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.498643 27863 raft_consensus.cc:348] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.498761 27863 raft_consensus.cc:374] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.498785 27863 raft_consensus.cc:729] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.498801 27859 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:10.498899 27859 ts_tablet_manager.cc:1367] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20240502 20:47:10.498893 27863 consensus_queue.cc:260] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.499150 27863 ts_tablet_manager.cc:1398] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:10.499482 27859 raft_consensus.cc:348] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.499691 27859 raft_consensus.cc:374] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.499797 27859 raft_consensus.cc:729] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.499924 27743 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:10.500011 27743 ts_tablet_manager.cc:1367] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240502 20:47:10.499992 27859 consensus_queue.cc:260] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.500327 27859 ts_tablet_manager.cc:1398] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:10.500492 27859 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:10.500526 27743 raft_consensus.cc:348] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.500635 27743 raft_consensus.cc:374] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.500670 27743 raft_consensus.cc:729] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.500808 27863 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:10.500794 27743 consensus_queue.cc:260] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.501063 27743 ts_tablet_manager.cc:1398] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:10.501358 27859 tablet_bootstrap.cc:654] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.502444 27856 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:10.502537 27856 ts_tablet_manager.cc:1367] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20240502 20:47:10.503006 27856 raft_consensus.cc:348] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.503142 27856 raft_consensus.cc:374] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.503176 27856 raft_consensus.cc:729] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.503327 27856 consensus_queue.cc:260] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.503427 27863 tablet_bootstrap.cc:654] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.503787 27856 ts_tablet_manager.cc:1398] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 20:47:10.504426 27857 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:10.504532 27857 ts_tablet_manager.cc:1367] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 20:47:10.505045 27857 raft_consensus.cc:348] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.505542 27857 raft_consensus.cc:374] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.505600 27857 raft_consensus.cc:729] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.505793 27857 consensus_queue.cc:260] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.506201 27857 ts_tablet_manager.cc:1398] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:10.507118 27859 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:10.507230 27859 ts_tablet_manager.cc:1367] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240502 20:47:10.507846 27859 raft_consensus.cc:348] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.507974 27859 raft_consensus.cc:374] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.508060 27859 raft_consensus.cc:729] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.508212 27859 consensus_queue.cc:260] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.508638 27859 ts_tablet_manager.cc:1398] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:10.513260 27863 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:10.513362 27863 ts_tablet_manager.cc:1367] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 20:47:10.513796 27863 raft_consensus.cc:348] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.513927 27863 raft_consensus.cc:374] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:10.513954 27863 raft_consensus.cc:729] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:10.514122 27863 consensus_queue.cc:260] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.514407 27863 ts_tablet_manager.cc:1398] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:10.527324 27838 raft_consensus.cc:482] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:10.527482 27838 raft_consensus.cc:504] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.528402 27838 leader_election.cc:288] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:10.529338 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:10.529503 26624 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:10.529780 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:10.529945 26227 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:10.530197 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:10.530318 26756 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:10.530823 26033 leader_election.cc:302] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3; no voters:
I20240502 20:47:10.531033 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:10.530941 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:10.531168 26491 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:10.531474 26360 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:10.531595 27838 raft_consensus.cc:2781] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:10.531649 27838 raft_consensus.cc:482] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:10.531682 27838 raft_consensus.cc:3037] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.532387 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:10.532788 27838 raft_consensus.cc:504] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.533303 27838 leader_election.cc:288] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Requested vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:10.534060 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:10.534055 25963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:10.534163 26491 raft_consensus.cc:3037] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.534554 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:10.534587 25962 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:10.534688 26227 raft_consensus.cc:3037] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.535071 26491 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:10.535579 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:10.535740 26227 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:10.535693 26624 raft_consensus.cc:3037] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.536072 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:10.536070 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9f56f646f94461ab85acea3efdc14f4" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:10.536190 26360 raft_consensus.cc:3037] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.536192 26756 raft_consensus.cc:3037] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.536777 26624 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:10.537139 26756 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:10.537140 26360 raft_consensus.cc:2454] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:10.537227 26031 leader_election.cc:302] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 5 responses out of 7 voters: 4 yes votes; 1 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2; no voters: 3c6dc91a7df244ab82c1161799ba2ff3
I20240502 20:47:10.537385 27838 raft_consensus.cc:2781] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:10.537468 27838 raft_consensus.cc:686] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Becoming Leader. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Running, Role: LEADER
I20240502 20:47:10.537619 27838 consensus_queue.cc:237] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.539937 25814 catalog_manager.cc:5484] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73a41df730ef429d84fe648df03a2701 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:10.549993 27815 raft_consensus.cc:482] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:10.550118 27815 raft_consensus.cc:504] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.550745 27815 leader_election.cc:288] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:10.551064 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:10.551134 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:10.551208 26756 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:10.551287 26227 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:10.551265 25963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:10.551321 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:10.551393 25963 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:10.551440 26491 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:10.551595 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:10.551753 26624 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:10.551891 26296 leader_election.cc:302] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 6173ed1979b94e509bf1c843a5183690, 9aaa16c4fc46478f90a3d97b010330c2, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:10.551927 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:10.552055 27815 raft_consensus.cc:2781] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:10.552054 26094 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 0.
I20240502 20:47:10.552107 27815 raft_consensus.cc:482] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:10.552142 27815 raft_consensus.cc:3037] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.552562 27825 raft_consensus.cc:482] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:10.552680 27825 raft_consensus.cc:504] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.553186 27815 raft_consensus.cc:504] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.553434 27825 leader_election.cc:288] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:10.553810 27815 leader_election.cc:288] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Requested vote from peers 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:10.553835 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:10.553845 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:10.553948 26624 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.553948 26094 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.554209 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:10.554258 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:10.554323 26360 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.554324 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:10.554352 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:10.554389 26491 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.554423 25962 raft_consensus.cc:3037] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.554442 26227 raft_consensus.cc:3037] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.554566 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:10.554689 26755 raft_consensus.cc:3037] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.555202 26227 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:10.555469 25962 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:10.555600 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:10.555645 26755 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:10.555774 26491 raft_consensus.cc:3037] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.556046 26297 leader_election.cc:302] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 6173ed1979b94e509bf1c843a5183690, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:10.556479 26163 leader_election.cc:302] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 9aaa16c4fc46478f90a3d97b010330c2, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:10.556599 25963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:10.556692 25963 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.556769 26491 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:10.556787 27825 raft_consensus.cc:2781] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:10.556833 27825 raft_consensus.cc:482] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:10.556869 27825 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.557253 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:10.557308 27815 raft_consensus.cc:2781] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:10.557376 26094 raft_consensus.cc:3037] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.557394 27815 raft_consensus.cc:686] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Becoming Leader. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Running, Role: LEADER
I20240502 20:47:10.557540 27815 consensus_queue.cc:237] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:10.557811 27825 raft_consensus.cc:504] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.557858 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:10.557963 26756 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 0.
I20240502 20:47:10.558377 27825 leader_election.cc:288] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [CANDIDATE]: Term 1 election: Requested vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:10.558418 26094 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:10.558933 25963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:10.558919 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:10.558941 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:10.559026 25963 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.559048 26625 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.559058 26360 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.559559 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:10.559648 26491 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.560086 26625 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.560091 26360 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.560606 26491 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.560634 25963 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.560874 26164 leader_election.cc:302] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 9aaa16c4fc46478f90a3d97b010330c2, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:10.561074 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:10.561177 26094 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.561517 26756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "6173ed1979b94e509bf1c843a5183690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:10.561412 25815 catalog_manager.cc:5484] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132). New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:10.561640 26756 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.562047 26094 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.562139 27825 raft_consensus.cc:2781] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:10.562232 27825 raft_consensus.cc:686] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Becoming Leader. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Running, Role: LEADER
I20240502 20:47:10.562366 27825 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:10.562651 26756 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6173ed1979b94e509bf1c843a5183690 in term 1.
I20240502 20:47:10.563112 26624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "406675832bd84f4ea6de10c0ae14ec53" candidate_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:10.563235 26624 raft_consensus.cc:3037] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.564224 26624 raft_consensus.cc:2454] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbee1301f7b94c6ab339ecaccc4ce740 in term 1.
I20240502 20:47:10.564687 25818 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6173ed1979b94e509bf1c843a5183690 (127.9.82.131). New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
W20240502 20:47:10.704540 27884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:10.704877 27884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:10.709229 27884 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_5'
I20240502 20:47:10.799765 26756 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.799799 26624 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.800244 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.800412 27777 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.802246 26094 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.804051 25963 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.805025 26491 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.805693 26227 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.805908 27585 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.806054 27816 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.806381 26756 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.806367 27816 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.806603 26625 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.806932 27815 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.807855 27585 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.812947 27585 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.814324 25962 raft_consensus.cc:3037] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:10.815439 25962 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.815822 26757 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.816541 27476 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.816766 26625 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.816823 27476 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.817296 27838 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.822690 26360 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.827913 26491 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.831533 26227 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.831866 27838 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.832019 27474 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.832343 27474 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.833352 25965 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.833854 27777 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.834383 26096 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.835093 26360 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.835502 26491 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:10.840015 27499 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.841588 27499 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:10.875370 27777 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 220.607 ms
time per row: 0.110304 ms
I20240502 20:47:10.986842 25815 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52614:
name: "rebalance_test_table_6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 20:47:10.987424 25815 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_6 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 20:47:10.993861 25944 tablet_service.cc:1467] Processing CreateTablet for tablet fe3671f95cd0488cbdf684011ad3d1e3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.993850 26208 tablet_service.cc:1467] Processing CreateTablet for tablet fe3671f95cd0488cbdf684011ad3d1e3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.994207 26208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3671f95cd0488cbdf684011ad3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.994210 25944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3671f95cd0488cbdf684011ad3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.994688 26209 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6052089aac4ad79f71a50b97c3debf (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.994920 26209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6052089aac4ad79f71a50b97c3debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.995054 25945 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6052089aac4ad79f71a50b97c3debf (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.995311 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6052089aac4ad79f71a50b97c3debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.996060 26736 tablet_service.cc:1467] Processing CreateTablet for tablet fe3671f95cd0488cbdf684011ad3d1e3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.996356 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3671f95cd0488cbdf684011ad3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.996587 27743 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:10.997444 27743 tablet_bootstrap.cc:654] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:10.997552 26076 tablet_service.cc:1467] Processing CreateTablet for tablet fe3671f95cd0488cbdf684011ad3d1e3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.997761 26077 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6052089aac4ad79f71a50b97c3debf (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.997820 26076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3671f95cd0488cbdf684011ad3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.998186 26339 tablet_service.cc:1467] Processing CreateTablet for tablet fe3671f95cd0488cbdf684011ad3d1e3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:10.998345 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6052089aac4ad79f71a50b97c3debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.998471 26339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3671f95cd0488cbdf684011ad3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:10.998749 27856 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:10.999583 27856 tablet_bootstrap.cc:654] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.000515 26604 tablet_service.cc:1467] Processing CreateTablet for tablet fe3671f95cd0488cbdf684011ad3d1e3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.000785 27857 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:11.000802 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3671f95cd0488cbdf684011ad3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.001487 26341 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6052089aac4ad79f71a50b97c3debf (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.001613 27857 tablet_bootstrap.cc:654] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.001708 26341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6052089aac4ad79f71a50b97c3debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.002831 27857 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:11.002921 27857 ts_tablet_manager.cc:1367] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:11.002933 27863 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:11.003345 26471 tablet_service.cc:1467] Processing CreateTablet for tablet fe3671f95cd0488cbdf684011ad3d1e3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.003327 27857 raft_consensus.cc:348] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.003458 27857 raft_consensus.cc:374] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.003489 27857 raft_consensus.cc:729] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.003624 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3671f95cd0488cbdf684011ad3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.003633 27857 consensus_queue.cc:260] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.003922 27863 tablet_bootstrap.cc:654] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.003978 27857 ts_tablet_manager.cc:1398] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.004705 27857 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:11.005518 27857 tablet_bootstrap.cc:654] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.006770 27859 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:11.007696 27859 tablet_bootstrap.cc:654] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.008931 27859 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:11.009028 27859 ts_tablet_manager.cc:1367] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:11.008982 26604 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6052089aac4ad79f71a50b97c3debf (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.008880 26471 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6052089aac4ad79f71a50b97c3debf (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.009266 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6052089aac4ad79f71a50b97c3debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.009297 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6052089aac4ad79f71a50b97c3debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.009586 27859 raft_consensus.cc:348] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.009718 27859 raft_consensus.cc:374] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.009748 27859 raft_consensus.cc:729] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.009876 27859 consensus_queue.cc:260] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.009938 27944 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:11.010208 27859 ts_tablet_manager.cc:1398] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.010947 27944 tablet_bootstrap.cc:654] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.011564 27856 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:11.011564 27857 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:11.011657 27856 ts_tablet_manager.cc:1367] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20240502 20:47:11.011657 27857 ts_tablet_manager.cc:1367] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 20:47:11.011863 27946 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:11.012070 26077 tablet_service.cc:1467] Processing CreateTablet for tablet 23d260f1c3be4dd1b18fc82af355c137 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.012125 27857 raft_consensus.cc:348] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.012241 27857 raft_consensus.cc:374] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.012274 27857 raft_consensus.cc:729] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.012301 26077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d260f1c3be4dd1b18fc82af355c137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.012403 27857 consensus_queue.cc:260] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.012661 27946 tablet_bootstrap.cc:654] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.012692 27857 ts_tablet_manager.cc:1398] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.012692 27856 raft_consensus.cc:348] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.012846 27856 raft_consensus.cc:374] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.012885 27856 raft_consensus.cc:729] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.013007 27856 consensus_queue.cc:260] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.013339 27856 ts_tablet_manager.cc:1398] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:11.013526 27856 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:11.013818 27743 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:11.013916 27743 ts_tablet_manager.cc:1367] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20240502 20:47:11.014415 27856 tablet_bootstrap.cc:654] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.014328 27743 raft_consensus.cc:348] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.014464 27743 raft_consensus.cc:374] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.014495 27743 raft_consensus.cc:729] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.014539 25945 tablet_service.cc:1467] Processing CreateTablet for tablet 23d260f1c3be4dd1b18fc82af355c137 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.014636 27743 consensus_queue.cc:260] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.014828 25945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d260f1c3be4dd1b18fc82af355c137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.014983 27743 ts_tablet_manager.cc:1398] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:11.015152 27743 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:11.015478 26736 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6052089aac4ad79f71a50b97c3debf (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.015484 26735 tablet_service.cc:1467] Processing CreateTablet for tablet 23d260f1c3be4dd1b18fc82af355c137 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.015830 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6052089aac4ad79f71a50b97c3debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.015998 26735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d260f1c3be4dd1b18fc82af355c137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.016206 27743 tablet_bootstrap.cc:654] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.017767 27743 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:11.017855 27743 ts_tablet_manager.cc:1367] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:11.018265 27743 raft_consensus.cc:348] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.018371 27743 raft_consensus.cc:374] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.018401 27743 raft_consensus.cc:729] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.018503 27743 consensus_queue.cc:260] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.018779 27743 ts_tablet_manager.cc:1398] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.019243 26341 tablet_service.cc:1467] Processing CreateTablet for tablet 23d260f1c3be4dd1b18fc82af355c137 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.019526 26341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d260f1c3be4dd1b18fc82af355c137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.019646 26209 tablet_service.cc:1467] Processing CreateTablet for tablet 23d260f1c3be4dd1b18fc82af355c137 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.019910 26209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d260f1c3be4dd1b18fc82af355c137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.020110 27944 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:11.020207 27944 ts_tablet_manager.cc:1367] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 20:47:11.020838 27944 raft_consensus.cc:348] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.020953 27944 raft_consensus.cc:374] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.020989 27944 raft_consensus.cc:729] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.021111 27944 consensus_queue.cc:260] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.021410 27944 ts_tablet_manager.cc:1398] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.022002 27857 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:11.022372 27743 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:11.022362 27863 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:11.022461 27863 ts_tablet_manager.cc:1367] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20240502 20:47:11.022929 27857 tablet_bootstrap.cc:654] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.022917 27863 raft_consensus.cc:348] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.023041 27863 raft_consensus.cc:374] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.023075 27863 raft_consensus.cc:729] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.023202 27743 tablet_bootstrap.cc:654] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.023216 27863 consensus_queue.cc:260] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.023536 27863 ts_tablet_manager.cc:1398] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:11.024314 27863 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:11.025279 27863 tablet_bootstrap.cc:654] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.025748 26471 tablet_service.cc:1467] Processing CreateTablet for tablet 23d260f1c3be4dd1b18fc82af355c137 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.026022 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d260f1c3be4dd1b18fc82af355c137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.026034 27944 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:11.026918 27944 tablet_bootstrap.cc:654] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.028736 27944 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:11.028836 27863 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:11.028923 27863 ts_tablet_manager.cc:1367] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240502 20:47:11.028925 27944 ts_tablet_manager.cc:1367] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 20:47:11.029359 27863 raft_consensus.cc:348] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.029515 27863 raft_consensus.cc:374] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.029556 27863 raft_consensus.cc:729] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.029564 26604 tablet_service.cc:1467] Processing CreateTablet for tablet 23d260f1c3be4dd1b18fc82af355c137 (DEFAULT_TABLE table=rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 20:47:11.029455 27944 raft_consensus.cc:348] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.029711 27944 raft_consensus.cc:374] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.029747 27944 raft_consensus.cc:729] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.029698 27863 consensus_queue.cc:260] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.029835 26604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d260f1c3be4dd1b18fc82af355c137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:11.029862 27944 consensus_queue.cc:260] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.030009 27863 ts_tablet_manager.cc:1398] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:11.030356 27944 ts_tablet_manager.cc:1398] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.030519 27944 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3: Bootstrap starting.
I20240502 20:47:11.031184 27859 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:11.032092 27944 tablet_bootstrap.cc:654] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.032114 27863 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:11.032166 27859 tablet_bootstrap.cc:654] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.033739 27743 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690: No bootstrap required, opened a new log
I20240502 20:47:11.033843 27743 ts_tablet_manager.cc:1367] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20240502 20:47:11.034148 27857 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740: No bootstrap required, opened a new log
I20240502 20:47:11.034170 27946 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:11.034242 27863 tablet_bootstrap.cc:654] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.034243 27857 ts_tablet_manager.cc:1367] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20240502 20:47:11.034266 27946 ts_tablet_manager.cc:1367] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.000s
I20240502 20:47:11.034310 27743 raft_consensus.cc:348] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.034440 27743 raft_consensus.cc:374] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.034469 27743 raft_consensus.cc:729] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.034610 27743 consensus_queue.cc:260] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.034770 27946 raft_consensus.cc:348] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.034770 27857 raft_consensus.cc:348] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.034889 27946 raft_consensus.cc:374] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.034911 27857 raft_consensus.cc:374] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.034925 27946 raft_consensus.cc:729] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.034945 27743 ts_tablet_manager.cc:1398] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.034952 27857 raft_consensus.cc:729] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.035068 27946 consensus_queue.cc:260] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.035108 27857 consensus_queue.cc:260] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.035365 27946 ts_tablet_manager.cc:1398] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:11.035409 27857 ts_tablet_manager.cc:1398] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.035540 27946 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:11.035959 27856 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:11.036052 27856 ts_tablet_manager.cc:1367] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20240502 20:47:11.036549 27856 raft_consensus.cc:348] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.036703 27856 raft_consensus.cc:374] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.036738 27856 raft_consensus.cc:729] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.036870 27856 consensus_queue.cc:260] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.037070 27946 tablet_bootstrap.cc:654] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.037214 27856 ts_tablet_manager.cc:1398] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.037410 27856 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:11.038358 27856 tablet_bootstrap.cc:654] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.041021 27859 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:11.041144 27859 ts_tablet_manager.cc:1367] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20240502 20:47:11.041369 27863 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: No bootstrap required, opened a new log
I20240502 20:47:11.041466 27863 ts_tablet_manager.cc:1367] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20240502 20:47:11.041672 27944 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3: No bootstrap required, opened a new log
I20240502 20:47:11.041754 27944 ts_tablet_manager.cc:1367] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 20:47:11.041661 27859 raft_consensus.cc:348] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.041796 27859 raft_consensus.cc:374] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.041828 27859 raft_consensus.cc:729] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.041918 27863 raft_consensus.cc:348] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.041960 27859 consensus_queue.cc:260] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.042040 27863 raft_consensus.cc:374] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.042083 27863 raft_consensus.cc:729] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.042264 27859 ts_tablet_manager.cc:1398] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 20:47:11.042196 27944 raft_consensus.cc:348] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.042223 27863 consensus_queue.cc:260] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.042317 27944 raft_consensus.cc:374] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.042352 27944 raft_consensus.cc:729] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4908484400a4ce2aea341e9e1bdced3, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.042444 27859 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:11.042474 27944 consensus_queue.cc:260] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.042564 27863 ts_tablet_manager.cc:1398] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.042773 27944 ts_tablet_manager.cc:1398] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:11.043080 27856 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3: No bootstrap required, opened a new log
I20240502 20:47:11.043159 27856 ts_tablet_manager.cc:1367] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 20:47:11.043365 27859 tablet_bootstrap.cc:654] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.043623 27856 raft_consensus.cc:348] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.043771 27856 raft_consensus.cc:374] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.043756 27938 raft_consensus.cc:482] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:11.043808 27856 raft_consensus.cc:729] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.043845 27938 raft_consensus.cc:504] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.043915 27856 consensus_queue.cc:260] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.044241 27856 ts_tablet_manager.cc:1398] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.044600 27938 leader_election.cc:288] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:11.044770 27859 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2: No bootstrap required, opened a new log
I20240502 20:47:11.044837 27859 ts_tablet_manager.cc:1367] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:11.044814 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:11.044941 26094 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:11.045305 27859 raft_consensus.cc:348] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.045413 27859 raft_consensus.cc:374] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.045444 27859 raft_consensus.cc:729] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.045405 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:11.045404 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:11.045527 26360 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:11.045565 26227 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:11.045558 27859 consensus_queue.cc:260] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.045833 27859 ts_tablet_manager.cc:1398] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.045809 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:11.045933 26625 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:11.046105 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:11.046231 25962 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:11.046471 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:11.046589 26755 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 0.
I20240502 20:47:11.046610 26429 leader_election.cc:302] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2; no voters:
I20240502 20:47:11.046845 27735 raft_consensus.cc:2781] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:11.046908 27735 raft_consensus.cc:482] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:11.046954 27735 raft_consensus.cc:3037] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.048061 27946 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:11.048166 27946 ts_tablet_manager.cc:1367] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 20:47:11.048297 27735 raft_consensus.cc:504] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.048661 27946 raft_consensus.cc:348] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.048804 27946 raft_consensus.cc:374] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.048839 27946 raft_consensus.cc:729] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.048887 27735 leader_election.cc:288] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 election: Requested vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:11.048956 27946 consensus_queue.cc:260] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.049397 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:11.049520 26360 raft_consensus.cc:3037] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.049741 27946 ts_tablet_manager.cc:1398] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:11.049870 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:11.049911 27946 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:11.049962 26094 raft_consensus.cc:3037] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.050050 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:11.050158 26227 raft_consensus.cc:3037] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.050515 26360 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:11.050824 27946 tablet_bootstrap.cc:654] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701: Neither blocks nor log segments found. Creating new log.
I20240502 20:47:11.050900 26094 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:11.051182 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:11.051213 26227 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:11.051288 25962 raft_consensus.cc:3037] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.051910 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:11.052026 26625 raft_consensus.cc:3037] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.052320 25962 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:11.052505 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3671f95cd0488cbdf684011ad3d1e3" candidate_uuid: "9aaa16c4fc46478f90a3d97b010330c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:11.052616 26755 raft_consensus.cc:3037] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.052597 26427 leader_election.cc:302] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701, 9aaa16c4fc46478f90a3d97b010330c2, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:11.053040 26625 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:11.053314 27735 raft_consensus.cc:2781] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:11.053400 27735 raft_consensus.cc:686] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Becoming Leader. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Running, Role: LEADER
I20240502 20:47:11.053596 26755 raft_consensus.cc:2454] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aaa16c4fc46478f90a3d97b010330c2 in term 1.
I20240502 20:47:11.053580 27735 consensus_queue.cc:237] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.055588 27946 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701: No bootstrap required, opened a new log
I20240502 20:47:11.055699 27946 ts_tablet_manager.cc:1367] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 20:47:11.056181 27946 raft_consensus.cc:348] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.056269 27946 raft_consensus.cc:374] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 20:47:11.056289 27946 raft_consensus.cc:729] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: FOLLOWER
I20240502 20:47:11.056391 27946 consensus_queue.cc:260] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.056680 27946 ts_tablet_manager.cc:1398] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:11.056947 25819 catalog_manager.cc:5484] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133). New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:11.077749 27925 raft_consensus.cc:482] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:11.077854 27925 raft_consensus.cc:504] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.078512 27925 leader_election.cc:288] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:11.078866 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:11.078877 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:11.078915 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:11.079006 26360 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:11.079015 26625 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:11.079032 25962 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:11.079105 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:11.079252 26755 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:11.079514 26032 leader_election.cc:302] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:11.079571 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:11.079599 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:11.079712 26491 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:11.079779 26227 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 0.
I20240502 20:47:11.079906 27925 raft_consensus.cc:2781] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:11.079968 27925 raft_consensus.cc:482] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:11.080027 27925 raft_consensus.cc:3037] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.080971 27925 raft_consensus.cc:504] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.081450 27925 leader_election.cc:288] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Requested vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:11.081662 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:11.081753 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:11.081782 25962 raft_consensus.cc:3037] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.081853 26360 raft_consensus.cc:3037] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.081864 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:11.081985 26755 raft_consensus.cc:3037] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.082206 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:11.082304 26227 raft_consensus.cc:3037] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.082754 25962 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:11.082767 26360 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:11.083031 26755 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:11.083107 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:11.083145 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6052089aac4ad79f71a50b97c3debf" candidate_uuid: "73a41df730ef429d84fe648df03a2701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:11.083220 26491 raft_consensus.cc:3037] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.083242 26625 raft_consensus.cc:3037] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.083595 26032 leader_election.cc:302] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3, bbee1301f7b94c6ab339ecaccc4ce740; no voters:
I20240502 20:47:11.083627 26227 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:11.083844 27925 raft_consensus.cc:2781] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:11.083933 27925 raft_consensus.cc:686] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Becoming Leader. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Running, Role: LEADER
I20240502 20:47:11.084193 26625 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:11.084188 26491 raft_consensus.cc:2454] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73a41df730ef429d84fe648df03a2701 in term 1.
I20240502 20:47:11.084170 27925 consensus_queue.cc:237] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.086462 25820 catalog_manager.cc:5484] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73a41df730ef429d84fe648df03a2701 (127.9.82.130). New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:11.248510 27895 raft_consensus.cc:482] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:11.248661 27895 raft_consensus.cc:504] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.248818 27896 raft_consensus.cc:482] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 20:47:11.248975 27896 raft_consensus.cc:504] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.249507 27895 leader_election.cc:288] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:11.249655 27896 leader_election.cc:288] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:11.249832 26094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:11.249969 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701" is_pre_election: true
I20240502 20:47:11.249998 26094 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:11.250260 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:11.250258 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" is_pre_election: true
I20240502 20:47:11.250385 25962 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:11.250383 26625 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:11.250459 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" is_pre_election: true
I20240502 20:47:11.250595 25965 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:11.250854 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:11.251001 26227 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:11.251001 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:11.251049 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:11.251137 26360 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:11.251178 26492 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 0.
I20240502 20:47:11.251329 26691 leader_election.cc:302] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, b4908484400a4ce2aea341e9e1bdced3; no voters:
I20240502 20:47:11.251461 26560 leader_election.cc:302] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 5 responses out of 7 voters: 4 yes votes; 1 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, bbee1301f7b94c6ab339ecaccc4ce740; no voters: 73a41df730ef429d84fe648df03a2701
I20240502 20:47:11.251507 27895 raft_consensus.cc:2781] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:11.251569 27895 raft_consensus.cc:482] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:11.251617 27895 raft_consensus.cc:3037] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.251737 27896 raft_consensus.cc:2781] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 20:47:11.251794 27896 raft_consensus.cc:482] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 20:47:11.251832 27896 raft_consensus.cc:3037] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.252068 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3" is_pre_election: true
I20240502 20:47:11.252532 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2" is_pre_election: true
I20240502 20:47:11.252672 26492 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:11.252993 27896 raft_consensus.cc:504] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.253015 27895 raft_consensus.cc:504] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.253230 26755 raft_consensus.cc:2379] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in current term 1: Already voted for candidate b4908484400a4ce2aea341e9e1bdced3 in this term.
I20240502 20:47:11.253625 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" is_pre_election: true
I20240502 20:47:11.253700 25965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:11.253747 26360 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:11.253808 25965 raft_consensus.cc:3037] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.253872 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:11.253978 26096 raft_consensus.cc:3037] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.254069 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690" is_pre_election: true
I20240502 20:47:11.254204 26227 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 0.
I20240502 20:47:11.254256 27895 leader_election.cc:288] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:11.254635 25962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:11.254891 25965 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:11.254891 26096 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:11.255400 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:11.255537 26096 raft_consensus.cc:2379] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b4908484400a4ce2aea341e9e1bdced3 in current term 1: Already voted for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in this term.
I20240502 20:47:11.255533 26625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
I20240502 20:47:11.255600 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:11.255666 26625 raft_consensus.cc:2379] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b4908484400a4ce2aea341e9e1bdced3 in current term 1: Already voted for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in this term.
I20240502 20:47:11.255707 26491 raft_consensus.cc:3037] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.255714 27896 leader_election.cc:288] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 election: Requested vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:11.256186 26492 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:11.256187 26227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:11.256304 26227 raft_consensus.cc:3037] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.256690 26491 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4908484400a4ce2aea341e9e1bdced3 in term 1.
I20240502 20:47:11.256717 26359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:11.256757 26360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbee1301f7b94c6ab339ecaccc4ce740"
I20240502 20:47:11.256820 26359 raft_consensus.cc:3037] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 0 FOLLOWER]: Advancing to term 1
I20240502 20:47:11.257375 26692 leader_election.cc:302] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 7 voters: 1 yes votes; 4 no votes. yes voters: b4908484400a4ce2aea341e9e1bdced3; no voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 73a41df730ef429d84fe648df03a2701, bbee1301f7b94c6ab339ecaccc4ce740
I20240502 20:47:11.257386 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "b4908484400a4ce2aea341e9e1bdced3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:11.257602 26227 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:11.257880 27895 raft_consensus.cc:2726] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240502 20:47:11.257864 26560 leader_election.cc:302] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 5 responses out of 7 voters: 4 yes votes; 1 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 73a41df730ef429d84fe648df03a2701; no voters: 9aaa16c4fc46478f90a3d97b010330c2
I20240502 20:47:11.257895 26359 raft_consensus.cc:2454] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 1.
I20240502 20:47:11.258013 27896 raft_consensus.cc:2781] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 20:47:11.258112 27896 raft_consensus.cc:686] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Becoming Leader. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Running, Role: LEADER
I20240502 20:47:11.258127 26755 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d260f1c3be4dd1b18fc82af355c137" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:11.258265 26755 raft_consensus.cc:2379] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in current term 1: Already voted for candidate b4908484400a4ce2aea341e9e1bdced3 in this term.
I20240502 20:47:11.258271 27896 consensus_queue.cc:237] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:11.260915 25820 catalog_manager.cc:5484] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134). New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } }
W20240502 20:47:11.430889 27969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:11.431221 27969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:11.434417 27969 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_6'
I20240502 20:47:11.461072 27735 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.485584 27925 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.488874 27735 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.496709 27925 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.514724 27735 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.523352 27938 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.531176 27938 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.532390 26094 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:11.533898 27938 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.533903 27925 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.539362 27838 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.539673 27838 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.541150 27925 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.589279 26755 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:11.589825 27896 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.590679 26491 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:11.590844 26360 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:11.591219 27611 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.592437 27611 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.601212 25962 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:11.601213 26227 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:11.601610 27896 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.601923 27896 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 20:47:11.607682 26096 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 20:47:11.611300 28047 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 207.697 ms
time per row: 0.103849 ms
I20240502 20:47:11.700150 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.136:41039
--local_ip_for_outbound_sockets=127.9.82.136
--tserver_master_addrs=127.9.82.190:37939
--webserver_port=45641
--webserver_interface=127.9.82.136
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 20:47:11.815975 28063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:11.816362 28063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:11.816447 28063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:11.819667 28063 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:11.819773 28063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:11.819854 28063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.136
I20240502 20:47:11.823370 28063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.136:41039
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.9.82.136
--webserver_port=45641
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.28063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.136
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:11.824242 28063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:11.825328 28063 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:11.833597 28068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:11.834025 28071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:11.834776 28069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:11.835335 28063 server_base.cc:1034] running on GCE node
I20240502 20:47:11.835777 28063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:11.836414 28063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:11.837576 28063 hybrid_clock.cc:648] HybridClock initialized: now 1714682831837565 us; error 30 us; skew 500 ppm
I20240502 20:47:11.839509 28063 webserver.cc:460] Webserver started at http://127.9.82.136:45641/ using document root <none> and password file <none>
I20240502 20:47:11.840118 28063 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:11.840198 28063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:11.844921 28063 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 20:47:11.846941 28077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:11.848021 28063 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 20:47:11.848145 28063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "706762b60f514a048c4935e359027441"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:11.848560 28063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:11.867811 28063 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:11.868444 28063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:11.868602 28063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:11.869167 28063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:11.870159 28063 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:11.870208 28063 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:11.870263 28063 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:11.870296 28063 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:11.879613 28063 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.136:41039
I20240502 20:47:11.879638 28190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.136:41039 every 8 connection(s)
I20240502 20:47:11.880674 28063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 20:47:11.886447 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 28063
I20240502 20:47:11.886909 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.137:35891
--local_ip_for_outbound_sockets=127.9.82.137
--tserver_master_addrs=127.9.82.190:37939
--webserver_port=35593
--webserver_interface=127.9.82.137
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:11.892361 28191 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:11.892567 28191 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:11.893151 28191 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:11.894258 25815 ts_manager.cc:194] Re-registered known tserver with Master: 706762b60f514a048c4935e359027441 (127.9.82.136:41039)
I20240502 20:47:11.894831 25815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.136:47565
W20240502 20:47:12.016611 28194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:12.016845 28194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:12.016893 28194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:12.019987 28194 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:12.020093 28194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:12.020172 28194 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.137
I20240502 20:47:12.024302 28194 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.137:35891
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--webserver_interface=127.9.82.137
--webserver_port=35593
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.28194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.137
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:12.025226 28194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:12.026502 28194 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:12.035040 28200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:12.035557 28199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:12.036145 28202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:12.036808 28194 server_base.cc:1034] running on GCE node
I20240502 20:47:12.037225 28194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:12.037789 28194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:12.038954 28194 hybrid_clock.cc:648] HybridClock initialized: now 1714682832038939 us; error 29 us; skew 500 ppm
I20240502 20:47:12.041016 28194 webserver.cc:460] Webserver started at http://127.9.82.137:35593/ using document root <none> and password file <none>
I20240502 20:47:12.041682 28194 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:12.041769 28194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:12.045948 28194 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20240502 20:47:12.048018 28208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:12.049157 28194 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20240502 20:47:12.049260 28194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
uuid: "cc2b212930b84db1bb56f6952197955d"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:12.049787 28194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:12.064004 28194 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:12.064610 28194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:12.064765 28194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:12.065408 28194 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:12.066488 28194 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:12.066534 28194 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:12.066579 28194 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:12.066612 28194 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:12.076122 28194 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.137:35891
I20240502 20:47:12.076186 28321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.137:35891 every 8 connection(s)
I20240502 20:47:12.077239 28194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-8/data/info.pb
I20240502 20:47:12.086154 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 28194
I20240502 20:47:12.086504 28322 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:12.086609 9546 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
/tmp/dist-test-taskIC8fEc/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/logs
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.82.138:38195
--local_ip_for_outbound_sockets=127.9.82.138
--tserver_master_addrs=127.9.82.190:37939
--webserver_port=37413
--webserver_interface=127.9.82.138
--builtin_ntp_servers=127.9.82.148:40439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 20:47:12.086751 28322 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:12.087441 28322 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:12.088763 25815 ts_manager.cc:194] Re-registered known tserver with Master: cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891)
I20240502 20:47:12.089987 25815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.137:38777
W20240502 20:47:12.216542 28325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 20:47:12.216811 28325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 20:47:12.216866 28325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 20:47:12.220217 28325 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 20:47:12.220299 28325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 20:47:12.220381 28325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.82.138
I20240502 20:47:12.224246 28325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.82.148:40439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data
--fs_wal_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.82.138:38195
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data/info.pb
--webserver_interface=127.9.82.138
--webserver_port=37413
--tserver_master_addrs=127.9.82.190:37939
--never_fsync=true
--heap_profile_path=/tmp/kudu.28325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.82.138
--log_dir=/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type DEBUG
built by None at 02 May 2024 20:15:58 UTC on efd1337a2aa3
build id 93
I20240502 20:47:12.225162 28325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 20:47:12.226385 28325 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 20:47:12.234982 28331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:12.235392 28333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 20:47:12.235888 28330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 20:47:12.236711 28325 server_base.cc:1034] running on GCE node
I20240502 20:47:12.237162 28325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 20:47:12.237787 28325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 20:47:12.238971 28325 hybrid_clock.cc:648] HybridClock initialized: now 1714682832238952 us; error 32 us; skew 500 ppm
I20240502 20:47:12.241268 28325 webserver.cc:460] Webserver started at http://127.9.82.138:37413/ using document root <none> and password file <none>
I20240502 20:47:12.241937 28325 fs_manager.cc:359] Metadata directory not provided
I20240502 20:47:12.242014 28325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 20:47:12.245496 28325 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 20:47:12.247663 28339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:12.248890 28325 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 20:47:12.248991 28325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data,/tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
uuid: "21a5e6dc2695447798b4a87e7c6108db"
format_stamp: "Formatted at 2024-05-02 20:47:03 on dist-test-slave-2pss"
I20240502 20:47:12.249436 28325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
metadata directory: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/wal
1 data directories: /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 20:47:12.288987 28325 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 20:47:12.289685 28325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 20:47:12.289849 28325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 20:47:12.290433 28325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 20:47:12.291527 28325 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 20:47:12.291591 28325 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:12.291643 28325 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 20:47:12.291666 28325 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 20:47:12.300707 28325 rpc_server.cc:307] RPC server started. Bound to: 127.9.82.138:38195
I20240502 20:47:12.300745 28452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.82.138:38195 every 8 connection(s)
I20240502 20:47:12.301751 28325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-9/data/info.pb
I20240502 20:47:12.305859 9546 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskIC8fEc/build/debug/bin/kudu as pid 28325
I20240502 20:47:12.312347 28453 heartbeater.cc:347] Connected to a master server at 127.9.82.190:37939
I20240502 20:47:12.312651 28453 heartbeater.cc:464] Registering TS with master...
I20240502 20:47:12.313493 28453 heartbeater.cc:511] Master 127.9.82.190:37939 requested a full tablet report, sending...
I20240502 20:47:12.314837 25815 ts_manager.cc:194] Re-registered known tserver with Master: 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195)
I20240502 20:47:12.315697 25815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.82.138:51587
I20240502 20:47:12.543131 25945 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:12.544188 28125 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:12.549935 26209 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:12.550206 28387 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:12.550478 26604 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:12.555308 26471 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:12.559898 26736 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:12.608824 26341 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:47:12.611547 26077 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:47:12.620795 28256 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:12.743091 25945 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:12.746564 26604 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:12.747282 28387 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:12.751914 28125 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:12.754649 26209 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:12.755952 28256 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:12.758316 26471 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:12.763849 26077 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:47:12.770241 26736 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:12.777396 26341 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:47:12.897248 28191 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
I20240502 20:47:12.930074 28387 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:12.932243 26209 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:12.932509 28125 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:12.935122 25945 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:12.945107 28256 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:12.952651 26471 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:12.957085 26604 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:12.965890 26736 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:12.973266 26077 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:47:12.983892 26341 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:47:13.030730 26625 consensus_queue.cc:237] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } }
I20240502 20:47:13.032519 26359 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.032720 26757 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.033015 28602 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.033074 26094 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.033296 26227 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.033433 27896 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.033715 26492 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.034122 27896 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.034490 25962 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.034942 27896 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.035094 28602 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.035427 27896 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.037338 28602 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } }
I20240502 20:47:13.038179 26757 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } }
I20240502 20:47:13.040817 26094 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } }
I20240502 20:47:13.041872 26359 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } }
I20240502 20:47:13.042353 26227 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } }
I20240502 20:47:13.043241 25962 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } }
I20240502 20:47:13.045925 25816 catalog_manager.cc:5484] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } }
I20240502 20:47:13.047504 26492 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } }
I20240502 20:47:13.054797 26625 consensus_queue.cc:237] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:13.056667 26227 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.057478 26094 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.057879 26757 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.057940 25962 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.057967 27896 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.058154 28603 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.058312 28602 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.058851 27896 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.059487 26492 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.060606 28603 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.060637 26359 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.061144 28604 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.061539 28602 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.062705 26625 consensus_queue.cc:237] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:13.064041 25808 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f81a35dbe00342f89c4a42a3cfbbeacc with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.063863 26094 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.065377 26755 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.065232 25962 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.065691 26757 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.066953 25965 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.067036 26094 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.067488 28605 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.067874 28605 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.068805 25819 catalog_manager.cc:5484] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.069650 26360 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.069794 26227 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.070395 26492 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.070652 26491 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.070840 26228 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.071168 28605 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.071843 28605 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.073902 28605 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.074855 26360 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.075201 28604 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.076356 26359 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.077878 26757 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.077908 25965 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.079592 26227 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.081857 25823 catalog_manager.cc:5484] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.083475 28606 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.084966 26492 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.088181 26096 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.092880 28322 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
W20240502 20:47:13.093331 26561 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 706762b60f514a048c4935e359027441 (127.9.82.136:41039): Couldn't send request to peer 706762b60f514a048c4935e359027441. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f81a35dbe00342f89c4a42a3cfbbeacc. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.101434 26227 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:13.103564 26757 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.104074 26359 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.104218 26492 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.104899 25962 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.104943 26096 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.104954 26625 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.105654 28643 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.106287 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.106913 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.107254 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.107532 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.108124 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.112221 26492 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.112313 25965 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.113762 26623 consensus_queue.cc:237] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.111670 28645 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.116571 25818 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.117640 26227 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.118032 28604 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.118238 26757 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.118430 26096 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.118983 28604 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.120049 28604 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.119930 26625 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.120918 26359 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.121351 26492 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.121836 25965 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.122118 26361 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.122318 28603 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.123845 27896 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.124082 27896 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 20:47:13.124931 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23d260f1c3be4dd1b18fc82af355c137. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.126801 28604 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.128396 26492 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.128535 26757 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.131354 25808 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 23d260f1c3be4dd1b18fc82af355c137 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.131322 25817 catalog_manager.cc:5484] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.131567 26096 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.134593 26227 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.134831 26359 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.136925 25965 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.140437 26096 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.143322 26757 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.146039 26227 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:13.148880 26096 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.149060 26492 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.149093 26359 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.149286 28640 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.149436 25965 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.149974 26625 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.149987 28642 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.150797 28645 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.151592 28639 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.153249 26757 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.153723 28639 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.154909 28640 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.155551 28644 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.156311 26757 consensus_queue.cc:237] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:13.156338 25965 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.157716 26625 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.158728 26359 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.158823 26492 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.159226 27895 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.159466 26227 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.159603 27895 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.159927 27895 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.160362 26625 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.160415 26096 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.160548 26094 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.161029 25815 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.162056 25809 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 679352ffb9884583a0f1ee092d4badb1 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.162220 25965 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.163030 26491 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.163636 26757 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.165897 27895 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.166276 27895 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.166556 27895 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 20:47:13.173022 26162 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 679352ffb9884583a0f1ee092d4badb1. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.172874 26359 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.175931 25965 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.177842 28657 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.178164 25816 catalog_manager.cc:5484] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.179667 26094 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.179769 26625 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.181315 26227 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.181459 26491 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.185180 26359 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.186898 26757 consensus_queue.cc:237] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:13.189308 26625 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.189765 27895 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.190189 26094 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.190574 26359 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.190796 27895 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.191334 27895 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.191529 25965 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.192158 28674 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.194219 26491 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.194604 28661 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.200018 26227 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.200266 26361 consensus_queue.cc:237] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:13.200615 28661 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 20:47:13.201182 26693 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 706762b60f514a048c4935e359027441 (127.9.82.136:41039): Couldn't send request to peer 706762b60f514a048c4935e359027441. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50134092a82f42b08ffacf2eff58b0f9. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.201164 28661 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.202631 26227 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.202759 26491 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.202819 26625 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.203040 28682 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.203285 26094 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.203378 27815 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.203619 26491 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.204267 28678 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.204133 25965 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.205118 26757 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.205085 28630 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.206617 27815 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.206741 25816 catalog_manager.cc:5484] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.206853 26359 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.209224 26228 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.209581 25965 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.209966 28630 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.212498 25810 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 50134092a82f42b08ffacf2eff58b0f9 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.213395 26096 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.213904 28630 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.214685 26492 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.215114 26625 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.216709 26757 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.217788 26625 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.218772 25816 catalog_manager.cc:5484] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.220126 25965 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.221421 26094 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.224948 26227 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.225328 26359 consensus_queue.cc:237] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.227340 26492 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.227912 26227 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.227922 25965 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.228331 28678 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.228986 26625 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.229791 28678 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.229854 26094 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.230067 28678 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.230168 27815 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.230409 26757 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.230762 28679 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.231070 28679 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.233004 28678 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.233932 26757 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.234969 25809 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 406675832bd84f4ea6de10c0ae14ec53 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.235138 26227 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.235500 25965 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.237149 26492 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.237443 26096 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.239560 26625 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.239647 25817 catalog_manager.cc:5484] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.245110 26096 consensus_queue.cc:237] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:13.247148 25965 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.247180 26757 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.247576 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.248029 26492 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.248042 26227 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.248011 28026 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.248497 26625 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.248809 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.249064 26359 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.249125 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.249451 28696 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 20:47:13.250262 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 406675832bd84f4ea6de10c0ae14ec53. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.250370 28026 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.252344 28696 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.252931 26492 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.253299 26359 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.255069 25965 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.256057 26757 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.256896 25818 catalog_manager.cc:5484] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.259954 26227 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.260175 26625 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.262733 26096 consensus_queue.cc:237] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
W20240502 20:47:13.263160 28698 consensus_queue.cc:1159] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b4908484400a4ce2aea341e9e1bdced3" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20240502 20:47:13.265177 25965 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.265324 26756 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.265370 26492 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.265869 26359 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.265961 26625 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.266084 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.266309 26227 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.266449 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.266770 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.267063 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.267355 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.267644 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 20:47:13.270576 26030 consensus_peers.cc:485] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a6052089aac4ad79f71a50b97c3debf. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.271088 28026 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.271273 26228 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.271577 26756 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.273758 26492 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.274475 25815 catalog_manager.cc:5484] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.275878 25808 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 6a6052089aac4ad79f71a50b97c3debf with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.277230 25965 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.279498 26625 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.282687 26359 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.284355 26361 consensus_queue.cc:237] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:13.286409 26492 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.286489 26756 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.286499 25965 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.286913 26096 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.286891 28679 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.287071 26228 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.287137 28682 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.287292 28630 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.287452 28679 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.287698 27815 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.288300 26625 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.288693 27815 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.290436 28630 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.291522 26756 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.292404 25965 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.292639 26228 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.293877 25816 catalog_manager.cc:5484] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } }
I20240502 20:47:13.294795 26492 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.295101 26096 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
W20240502 20:47:13.297735 27815 consensus_queue.cc:1159] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9aaa16c4fc46478f90a3d97b010330c2" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20240502 20:47:13.297919 26361 consensus_queue.cc:237] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.301323 26492 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.301560 26228 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.301764 28678 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.301999 28681 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.303448 25965 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.303808 28682 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.305435 26756 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.305385 28630 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.305838 25965 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.306957 25809 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e25072f604644d9595c95c1bd5bfd7db with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.307813 26228 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.308506 27815 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.308609 26096 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.308697 25823 catalog_manager.cc:5484] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.309062 27815 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 20:47:13.309466 26295 consensus_peers.cc:485] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e25072f604644d9595c95c1bd5bfd7db. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.310240 26096 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.310698 26756 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.311285 26492 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.316437 26625 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.316840 28630 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.317591 26625 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.318449 28453 heartbeater.cc:503] Master 127.9.82.190:37939 was elected leader, sending a full tablet report...
I20240502 20:47:13.319813 26625 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.329663 26094 consensus_queue.cc:237] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:13.331668 26625 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.331928 26361 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.332126 26756 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.332314 25965 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.332319 28026 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.332726 28026 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.332979 28709 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.333122 28698 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.333715 26492 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.335047 28698 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.335584 26228 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.336059 28709 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.337869 28698 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.338625 26361 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.338819 26228 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.340915 26625 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.342080 25823 catalog_manager.cc:5484] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.343230 25965 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
W20240502 20:47:13.346748 28709 consensus_queue.cc:1159] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b4908484400a4ce2aea341e9e1bdced3" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 4 } }
I20240502 20:47:13.346910 26094 consensus_queue.cc:237] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:13.349474 26492 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.349475 26756 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20240502 20:47:13.349571 26030 consensus_peers.cc:485] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9f56f646f94461ab85acea3efdc14f4. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.349961 26361 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.350028 28709 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.350224 26228 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.350714 26625 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.350847 26756 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.351392 25965 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.350610 28696 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20240502 20:47:13.352391 28467 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.352766 28026 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.353085 28709 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.353513 28711 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.355036 26492 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.357472 28711 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.357743 26361 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.357772 26228 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.360146 25808 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f9f56f646f94461ab85acea3efdc14f4 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.361019 26625 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.361321 25817 catalog_manager.cc:5484] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:13.363039 25965 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.365242 26492 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.365396 26756 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:13.370378 26228 consensus_queue.cc:237] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:13.372092 26094 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.372133 26492 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.372341 25965 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.372728 28643 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.372912 26361 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.372927 26756 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.372938 28640 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.373279 28644 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.373625 28639 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.374241 28644 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.375020 26625 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.375480 28639 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.376412 28644 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.377350 26756 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.378647 26625 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.378774 26492 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.378875 26094 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.379041 26361 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.380785 25818 catalog_manager.cc:5484] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } }
I20240502 20:47:13.383265 25965 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:13.386430 26228 consensus_queue.cc:237] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.388702 26756 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.388728 26492 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.388794 25965 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.389143 26361 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.389133 28642 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.389354 28643 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.391331 28645 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.391700 28645 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.392453 26625 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.393039 28640 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.394456 26096 consensus_queue.cc:237] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:13.396471 26228 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.396489 26492 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.396972 26757 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.396987 26361 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.397316 25962 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:13.397444 28698 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.397639 28026 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.397900 28026 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.398041 28696 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.398248 26625 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 20:47:13.398846 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00bf11a3e1c24449bba6a09d4ab280b0. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.398984 28711 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.399569 28640 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.399816 28698 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:13.400077 26756 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.402132 26359 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.402510 25809 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 00bf11a3e1c24449bba6a09d4ab280b0 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.402969 26094 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.403543 25817 catalog_manager.cc:5484] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:13.403825 28642 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.403961 26623 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.404845 26094 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.405504 26491 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.407212 28698 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.409881 26625 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.410197 26228 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.411605 26361 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.412034 25965 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.413131 25815 catalog_manager.cc:5484] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.414407 26756 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.416342 25962 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:13.418433 26491 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:13.419589 26094 consensus_queue.cc:237] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:13.422461 26625 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.422946 26756 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.423321 28467 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.423657 28467 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.424847 25962 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.425220 28467 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.427026 28026 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.427587 26228 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.428000 28467 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 20:47:13.428180 26033 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 706762b60f514a048c4935e359027441 (127.9.82.136:41039): Couldn't send request to peer 706762b60f514a048c4935e359027441. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec36083ee0ce441c9b2337a48d41a5fc. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:13.428247 26361 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.428563 25962 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.428702 25808 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ec36083ee0ce441c9b2337a48d41a5fc with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:13.428972 26491 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:13.429152 28697 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.429968 28697 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:13.430231 26228 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.430375 26361 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.431509 26625 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.432210 26756 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.433147 25818 catalog_manager.cc:5484] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.436342 26491 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:13.540007 28806 ts_tablet_manager.cc:902] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:13.540796 28806 tablet_copy_client.cc:308] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:39463
I20240502 20:47:13.544768 26249 tablet_copy_service.cc:140] P 6173ed1979b94e509bf1c843a5183690: Received BeginTabletCopySession request for tablet 679352ffb9884583a0f1ee092d4badb1 from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:46833)
I20240502 20:47:13.544914 26249 tablet_copy_service.cc:161] P 6173ed1979b94e509bf1c843a5183690: Beginning new tablet copy session on tablet 679352ffb9884583a0f1ee092d4badb1 from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:46833: session id = cc2b212930b84db1bb56f6952197955d-679352ffb9884583a0f1ee092d4badb1
I20240502 20:47:13.546068 26249 tablet_copy_source_session.cc:205] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.549196 28812 ts_tablet_manager.cc:902] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: Initiating tablet copy from peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:13.549841 28806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.550019 28812 tablet_copy_client.cc:308] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.134:39815
I20240502 20:47:13.556087 28806 tablet_copy_client.cc:783] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.556365 28806 tablet_copy_client.cc:647] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.558274 28806 tablet_copy_client.cc:523] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.559810 26645 tablet_copy_service.cc:140] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Received BeginTabletCopySession request for tablet f81a35dbe00342f89c4a42a3cfbbeacc from peer 706762b60f514a048c4935e359027441 ({username='slave'} at 127.9.82.136:60391)
I20240502 20:47:13.559962 26645 tablet_copy_service.cc:161] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Beginning new tablet copy session on tablet f81a35dbe00342f89c4a42a3cfbbeacc from peer 706762b60f514a048c4935e359027441 at {username='slave'} at 127.9.82.136:60391: session id = 706762b60f514a048c4935e359027441-f81a35dbe00342f89c4a42a3cfbbeacc
I20240502 20:47:13.560281 28806 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:13.561575 26645 tablet_copy_source_session.cc:205] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.565223 28812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81a35dbe00342f89c4a42a3cfbbeacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.566661 28806 log.cc:824] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:13.571993 28812 tablet_copy_client.cc:783] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.572314 28812 tablet_copy_client.cc:647] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.574174 28812 tablet_copy_client.cc:523] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.576156 28812 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: Bootstrap starting.
I20240502 20:47:13.583212 28812 log.cc:824] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:13.595373 28806 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.595832 28806 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:13.596184 28806 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.036s user 0.036s sys 0.000s
I20240502 20:47:13.601172 28806 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:13.601850 28806 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:13.602551 28806 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:13.603605 28806 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20240502 20:47:13.604503 26249 tablet_copy_service.cc:342] P 6173ed1979b94e509bf1c843a5183690: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-679352ffb9884583a0f1ee092d4badb1 received from {username='slave'} at 127.9.82.137:46833
I20240502 20:47:13.604607 26249 tablet_copy_service.cc:433] P 6173ed1979b94e509bf1c843a5183690: ending tablet copy session cc2b212930b84db1bb56f6952197955d-679352ffb9884583a0f1ee092d4badb1 on tablet 679352ffb9884583a0f1ee092d4badb1 with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:13.612600 28812 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.612948 28812 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: Bootstrap complete.
I20240502 20:47:13.613270 28812 ts_tablet_manager.cc:1367] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: Time spent bootstrapping tablet: real 0.037s user 0.036s sys 0.000s
I20240502 20:47:13.615305 28812 raft_consensus.cc:348] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:13.615612 28812 raft_consensus.cc:729] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 706762b60f514a048c4935e359027441, State: Initialized, Role: LEARNER
I20240502 20:47:13.615995 28812 consensus_queue.cc:260] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:13.616854 28812 ts_tablet_manager.cc:1398] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240502 20:47:13.617636 26645 tablet_copy_service.cc:342] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Request end of tablet copy session 706762b60f514a048c4935e359027441-f81a35dbe00342f89c4a42a3cfbbeacc received from {username='slave'} at 127.9.82.136:60391
I20240502 20:47:13.617748 26645 tablet_copy_service.cc:433] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: ending tablet copy session 706762b60f514a048c4935e359027441-f81a35dbe00342f89c4a42a3cfbbeacc on tablet f81a35dbe00342f89c4a42a3cfbbeacc with peer 706762b60f514a048c4935e359027441
I20240502 20:47:13.642608 28806 ts_tablet_manager.cc:902] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:13.643137 28806 tablet_copy_client.cc:308] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:34445
I20240502 20:47:13.646932 26117 tablet_copy_service.cc:140] P 73a41df730ef429d84fe648df03a2701: Received BeginTabletCopySession request for tablet 6a6052089aac4ad79f71a50b97c3debf from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:35785)
I20240502 20:47:13.647109 26117 tablet_copy_service.cc:161] P 73a41df730ef429d84fe648df03a2701: Beginning new tablet copy session on tablet 6a6052089aac4ad79f71a50b97c3debf from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:35785: session id = cc2b212930b84db1bb56f6952197955d-6a6052089aac4ad79f71a50b97c3debf
I20240502 20:47:13.648631 26117 tablet_copy_source_session.cc:205] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.649868 28806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6052089aac4ad79f71a50b97c3debf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.651582 28806 tablet_copy_client.cc:783] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.651791 28806 tablet_copy_client.cc:647] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.653295 28806 tablet_copy_client.cc:523] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.654470 28806 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:13.674018 28806 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.674361 28806 tablet_bootstrap.cc:492] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:13.674568 28806 ts_tablet_manager.cc:1367] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.020s user 0.017s sys 0.001s
I20240502 20:47:13.675194 28806 raft_consensus.cc:348] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:13.675318 28806 raft_consensus.cc:729] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:13.675422 28806 consensus_queue.cc:260] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:13.675673 28806 ts_tablet_manager.cc:1398] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:13.676385 26117 tablet_copy_service.cc:342] P 73a41df730ef429d84fe648df03a2701: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-6a6052089aac4ad79f71a50b97c3debf received from {username='slave'} at 127.9.82.137:35785
I20240502 20:47:13.676496 26117 tablet_copy_service.cc:433] P 73a41df730ef429d84fe648df03a2701: ending tablet copy session cc2b212930b84db1bb56f6952197955d-6a6052089aac4ad79f71a50b97c3debf on tablet 6a6052089aac4ad79f71a50b97c3debf with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:13.740912 28862 ts_tablet_manager.cc:902] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:13.741978 28862 tablet_copy_client.cc:308] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.134:39815
I20240502 20:47:13.746702 26645 tablet_copy_service.cc:140] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Received BeginTabletCopySession request for tablet 23d260f1c3be4dd1b18fc82af355c137 from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:50759)
I20240502 20:47:13.746814 26645 tablet_copy_service.cc:161] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Beginning new tablet copy session on tablet 23d260f1c3be4dd1b18fc82af355c137 from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:50759: session id = 21a5e6dc2695447798b4a87e7c6108db-23d260f1c3be4dd1b18fc82af355c137
I20240502 20:47:13.747505 26645 tablet_copy_source_session.cc:205] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.750819 28862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d260f1c3be4dd1b18fc82af355c137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.757138 28862 tablet_copy_client.cc:783] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.757350 28862 tablet_copy_client.cc:647] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.758956 28862 tablet_copy_client.cc:523] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.761040 28862 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:13.767827 28862 log.cc:824] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: Log is configured to *not* fsync() on all Append() calls
I20240502 20:47:13.788173 28862 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.788508 28862 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:13.788807 28862 ts_tablet_manager.cc:1367] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.028s user 0.027s sys 0.000s
I20240502 20:47:13.790906 28862 raft_consensus.cc:348] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.791136 28862 raft_consensus.cc:729] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:13.791471 28862 consensus_queue.cc:260] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.792487 28862 ts_tablet_manager.cc:1398] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20240502 20:47:13.793073 26645 tablet_copy_service.cc:342] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-23d260f1c3be4dd1b18fc82af355c137 received from {username='slave'} at 127.9.82.138:50759
I20240502 20:47:13.793159 26645 tablet_copy_service.cc:433] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-23d260f1c3be4dd1b18fc82af355c137 on tablet 23d260f1c3be4dd1b18fc82af355c137 with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:13.800071 28812 ts_tablet_manager.cc:902] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: Initiating tablet copy from peer b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:13.800544 28812 tablet_copy_client.cc:308] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.135:39673
I20240502 20:47:13.804085 26777 tablet_copy_service.cc:140] P b4908484400a4ce2aea341e9e1bdced3: Received BeginTabletCopySession request for tablet 50134092a82f42b08ffacf2eff58b0f9 from peer 706762b60f514a048c4935e359027441 ({username='slave'} at 127.9.82.136:53103)
I20240502 20:47:13.804235 26777 tablet_copy_service.cc:161] P b4908484400a4ce2aea341e9e1bdced3: Beginning new tablet copy session on tablet 50134092a82f42b08ffacf2eff58b0f9 from peer 706762b60f514a048c4935e359027441 at {username='slave'} at 127.9.82.136:53103: session id = 706762b60f514a048c4935e359027441-50134092a82f42b08ffacf2eff58b0f9
I20240502 20:47:13.805536 26777 tablet_copy_source_session.cc:205] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.806689 28812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.808463 28812 tablet_copy_client.cc:783] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.808610 28812 tablet_copy_client.cc:647] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.810402 28812 tablet_copy_client.cc:523] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.811463 28812 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: Bootstrap starting.
I20240502 20:47:13.826480 28862 ts_tablet_manager.cc:902] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125)
I20240502 20:47:13.826711 28890 ts_tablet_manager.cc:902] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125)
I20240502 20:47:13.826984 28862 tablet_copy_client.cc:308] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:43125
I20240502 20:47:13.827386 28890 tablet_copy_client.cc:308] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:43125
I20240502 20:47:13.831157 26381 tablet_copy_service.cc:140] P bbee1301f7b94c6ab339ecaccc4ce740: Received BeginTabletCopySession request for tablet 406675832bd84f4ea6de10c0ae14ec53 from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:55775)
I20240502 20:47:13.831337 26381 tablet_copy_service.cc:161] P bbee1301f7b94c6ab339ecaccc4ce740: Beginning new tablet copy session on tablet 406675832bd84f4ea6de10c0ae14ec53 from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:55775: session id = 21a5e6dc2695447798b4a87e7c6108db-406675832bd84f4ea6de10c0ae14ec53
I20240502 20:47:13.831835 26380 tablet_copy_service.cc:140] P bbee1301f7b94c6ab339ecaccc4ce740: Received BeginTabletCopySession request for tablet e25072f604644d9595c95c1bd5bfd7db from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:55775)
I20240502 20:47:13.831919 26380 tablet_copy_service.cc:161] P bbee1301f7b94c6ab339ecaccc4ce740: Beginning new tablet copy session on tablet e25072f604644d9595c95c1bd5bfd7db from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:55775: session id = 21a5e6dc2695447798b4a87e7c6108db-e25072f604644d9595c95c1bd5bfd7db
I20240502 20:47:13.832677 26380 tablet_copy_source_session.cc:205] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.832679 26381 tablet_copy_source_session.cc:205] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.833971 28890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25072f604644d9595c95c1bd5bfd7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.834167 28862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 406675832bd84f4ea6de10c0ae14ec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.836414 28862 tablet_copy_client.cc:783] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.836575 28862 tablet_copy_client.cc:647] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.837128 28890 tablet_copy_client.cc:783] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.837193 28812 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.837284 28890 tablet_copy_client.cc:647] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.837503 28812 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: Bootstrap complete.
I20240502 20:47:13.837693 28812 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: Time spent bootstrapping tablet: real 0.026s user 0.016s sys 0.004s
I20240502 20:47:13.838275 28812 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:13.838428 28812 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 706762b60f514a048c4935e359027441, State: Initialized, Role: LEARNER
I20240502 20:47:13.838548 28812 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:13.838871 28812 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:13.839015 28890 tablet_copy_client.cc:523] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.839563 26777 tablet_copy_service.cc:342] P b4908484400a4ce2aea341e9e1bdced3: Request end of tablet copy session 706762b60f514a048c4935e359027441-50134092a82f42b08ffacf2eff58b0f9 received from {username='slave'} at 127.9.82.136:53103
I20240502 20:47:13.839674 26777 tablet_copy_service.cc:433] P b4908484400a4ce2aea341e9e1bdced3: ending tablet copy session 706762b60f514a048c4935e359027441-50134092a82f42b08ffacf2eff58b0f9 on tablet 50134092a82f42b08ffacf2eff58b0f9 with peer 706762b60f514a048c4935e359027441
I20240502 20:47:13.840201 28862 tablet_copy_client.cc:523] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.840350 28890 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:13.841562 28862 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:13.845046 28899 ts_tablet_manager.cc:902] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:13.848232 28899 tablet_copy_client.cc:308] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:39463
I20240502 20:47:13.852756 26249 tablet_copy_service.cc:140] P 6173ed1979b94e509bf1c843a5183690: Received BeginTabletCopySession request for tablet 00bf11a3e1c24449bba6a09d4ab280b0 from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:50069)
I20240502 20:47:13.852869 26249 tablet_copy_service.cc:161] P 6173ed1979b94e509bf1c843a5183690: Beginning new tablet copy session on tablet 00bf11a3e1c24449bba6a09d4ab280b0 from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:50069: session id = 21a5e6dc2695447798b4a87e7c6108db-00bf11a3e1c24449bba6a09d4ab280b0
I20240502 20:47:13.853749 26249 tablet_copy_source_session.cc:205] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.855031 28899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bf11a3e1c24449bba6a09d4ab280b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.856711 28899 tablet_copy_client.cc:783] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.856868 28899 tablet_copy_client.cc:647] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.857870 28899 tablet_copy_client.cc:523] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.858863 28899 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:13.868803 28890 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.869109 28890 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:13.869311 28890 ts_tablet_manager.cc:1367] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.029s user 0.026s sys 0.002s
I20240502 20:47:13.869879 28890 raft_consensus.cc:348] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.870028 28890 raft_consensus.cc:729] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:13.870148 28890 consensus_queue.cc:260] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.871079 28806 ts_tablet_manager.cc:902] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:13.871081 28890 ts_tablet_manager.cc:1398] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:13.871575 28806 tablet_copy_client.cc:308] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:34445
I20240502 20:47:13.871605 26381 tablet_copy_service.cc:342] P bbee1301f7b94c6ab339ecaccc4ce740: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-e25072f604644d9595c95c1bd5bfd7db received from {username='slave'} at 127.9.82.138:55775
I20240502 20:47:13.871692 26381 tablet_copy_service.cc:433] P bbee1301f7b94c6ab339ecaccc4ce740: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-e25072f604644d9595c95c1bd5bfd7db on tablet e25072f604644d9595c95c1bd5bfd7db with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:13.872388 26117 tablet_copy_service.cc:140] P 73a41df730ef429d84fe648df03a2701: Received BeginTabletCopySession request for tablet f9f56f646f94461ab85acea3efdc14f4 from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:35785)
I20240502 20:47:13.872505 26117 tablet_copy_service.cc:161] P 73a41df730ef429d84fe648df03a2701: Beginning new tablet copy session on tablet f9f56f646f94461ab85acea3efdc14f4 from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:35785: session id = cc2b212930b84db1bb56f6952197955d-f9f56f646f94461ab85acea3efdc14f4
I20240502 20:47:13.873427 26117 tablet_copy_source_session.cc:205] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.874305 28806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9f56f646f94461ab85acea3efdc14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.876353 28806 tablet_copy_client.cc:783] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.876507 28806 tablet_copy_client.cc:647] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.877218 28812 ts_tablet_manager.cc:902] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: Initiating tablet copy from peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:13.877697 28812 tablet_copy_client.cc:308] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:34445
I20240502 20:47:13.877996 28862 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.878360 28862 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:13.878557 28862 ts_tablet_manager.cc:1367] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.037s user 0.028s sys 0.000s
I20240502 20:47:13.879040 28862 raft_consensus.cc:348] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.879190 28862 raft_consensus.cc:729] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:13.879287 28862 consensus_queue.cc:260] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.880046 28862 ts_tablet_manager.cc:1398] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:13.880604 26381 tablet_copy_service.cc:342] P bbee1301f7b94c6ab339ecaccc4ce740: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-406675832bd84f4ea6de10c0ae14ec53 received from {username='slave'} at 127.9.82.138:55775
I20240502 20:47:13.880697 26381 tablet_copy_service.cc:433] P bbee1301f7b94c6ab339ecaccc4ce740: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-406675832bd84f4ea6de10c0ae14ec53 on tablet 406675832bd84f4ea6de10c0ae14ec53 with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:13.883939 26117 tablet_copy_service.cc:140] P 73a41df730ef429d84fe648df03a2701: Received BeginTabletCopySession request for tablet ec36083ee0ce441c9b2337a48d41a5fc from peer 706762b60f514a048c4935e359027441 ({username='slave'} at 127.9.82.136:60197)
I20240502 20:47:13.884034 26117 tablet_copy_service.cc:161] P 73a41df730ef429d84fe648df03a2701: Beginning new tablet copy session on tablet ec36083ee0ce441c9b2337a48d41a5fc from peer 706762b60f514a048c4935e359027441 at {username='slave'} at 127.9.82.136:60197: session id = 706762b60f514a048c4935e359027441-ec36083ee0ce441c9b2337a48d41a5fc
I20240502 20:47:13.884865 26117 tablet_copy_source_session.cc:205] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:13.891592 28812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec36083ee0ce441c9b2337a48d41a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:13.893767 28812 tablet_copy_client.cc:783] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:13.893910 28812 tablet_copy_client.cc:647] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:13.895840 28812 tablet_copy_client.cc:523] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.897045 28812 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: Bootstrap starting.
I20240502 20:47:13.897053 28899 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.897308 28899 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:13.897441 28899 ts_tablet_manager.cc:1367] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.039s user 0.024s sys 0.001s
I20240502 20:47:13.897859 28899 raft_consensus.cc:348] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.897992 28899 raft_consensus.cc:729] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:13.898087 28899 consensus_queue.cc:260] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:13.898456 28899 ts_tablet_manager.cc:1398] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:13.899075 26249 tablet_copy_service.cc:342] P 6173ed1979b94e509bf1c843a5183690: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-00bf11a3e1c24449bba6a09d4ab280b0 received from {username='slave'} at 127.9.82.138:50069
I20240502 20:47:13.899153 26249 tablet_copy_service.cc:433] P 6173ed1979b94e509bf1c843a5183690: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-00bf11a3e1c24449bba6a09d4ab280b0 on tablet 00bf11a3e1c24449bba6a09d4ab280b0 with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:13.900352 28806 tablet_copy_client.cc:523] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:13.901717 28806 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:13.925655 28812 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.925966 28812 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: Bootstrap complete.
I20240502 20:47:13.926365 28812 ts_tablet_manager.cc:1367] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: Time spent bootstrapping tablet: real 0.029s user 0.023s sys 0.000s
I20240502 20:47:13.926713 28806 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:13.926992 28806 tablet_bootstrap.cc:492] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:13.927157 28806 ts_tablet_manager.cc:1367] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.025s user 0.021s sys 0.000s
I20240502 20:47:13.927394 28812 raft_consensus.cc:348] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:13.927520 28812 raft_consensus.cc:729] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 706762b60f514a048c4935e359027441, State: Initialized, Role: LEARNER
I20240502 20:47:13.927636 28812 consensus_queue.cc:260] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:13.927583 28806 raft_consensus.cc:348] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:13.927780 28806 raft_consensus.cc:729] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:13.927891 28806 consensus_queue.cc:260] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:13.928191 28806 ts_tablet_manager.cc:1398] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:47:13.928432 28812 ts_tablet_manager.cc:1398] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:13.929070 26117 tablet_copy_service.cc:342] P 73a41df730ef429d84fe648df03a2701: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-f9f56f646f94461ab85acea3efdc14f4 received from {username='slave'} at 127.9.82.137:35785
I20240502 20:47:13.929159 26117 tablet_copy_service.cc:433] P 73a41df730ef429d84fe648df03a2701: ending tablet copy session cc2b212930b84db1bb56f6952197955d-f9f56f646f94461ab85acea3efdc14f4 on tablet f9f56f646f94461ab85acea3efdc14f4 with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:13.929445 26116 tablet_copy_service.cc:342] P 73a41df730ef429d84fe648df03a2701: Request end of tablet copy session 706762b60f514a048c4935e359027441-ec36083ee0ce441c9b2337a48d41a5fc received from {username='slave'} at 127.9.82.136:60197
I20240502 20:47:13.929522 26116 tablet_copy_service.cc:433] P 73a41df730ef429d84fe648df03a2701: ending tablet copy session 706762b60f514a048c4935e359027441-ec36083ee0ce441c9b2337a48d41a5fc on tablet ec36083ee0ce441c9b2337a48d41a5fc with peer 706762b60f514a048c4935e359027441
I20240502 20:47:14.044955 28145 raft_consensus.cc:1203] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.122575 28276 raft_consensus.cc:1203] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.137826 28276 raft_consensus.cc:1203] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.155800 28406 raft_consensus.cc:1203] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.207618 28406 raft_consensus.cc:1203] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.268121 28406 raft_consensus.cc:1203] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.307771 28276 raft_consensus.cc:1203] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.385023 28145 raft_consensus.cc:1203] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.401307 28145 raft_consensus.cc:1203] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.403995 28406 raft_consensus.cc:1203] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:14.521526 28968 raft_consensus.cc:1050] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: attempting to promote NON_VOTER 706762b60f514a048c4935e359027441 to VOTER
I20240502 20:47:14.522138 28968 consensus_queue.cc:237] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:14.524200 26361 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.524353 26228 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.524658 26491 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.524713 28145 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.525063 26756 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.525162 28968 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.525472 25962 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.526053 26096 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.526158 28603 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.526315 28968 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.526724 28968 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.527055 28603 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.527204 28968 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.527346 29050 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.531347 28638 raft_consensus.cc:1050] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:14.532302 28638 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:14.534477 25965 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.534523 26757 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.534960 28642 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.535327 28642 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.535513 28276 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.538271 26625 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.538305 26096 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.538610 29056 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.538833 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.539031 28642 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.539548 26491 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.539637 26359 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.539770 29050 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.541874 26491 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.542775 28145 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.543853 26094 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.544754 25816 catalog_manager.cc:5484] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:14.545471 29056 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.545883 29056 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.546352 26228 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.549342 27825 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.549379 26361 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.551036 25962 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.551273 28275 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.551568 26756 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.553189 26757 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.554622 25815 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.557559 25962 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.560565 26096 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.562386 26625 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.564287 26623 consensus_queue.cc:237] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:14.566329 26361 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.566525 26096 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.566689 28145 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.567021 29050 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.567171 26228 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.568001 26361 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.568382 26491 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.568485 26492 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.568979 28967 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.569384 28967 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.569701 28967 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.572224 29048 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.572940 25962 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.573385 28967 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.574723 28967 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.575345 28145 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.575524 26359 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.576381 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f81a35dbe00342f89c4a42a3cfbbeacc with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:14.577610 26228 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:14.578341 25965 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.578716 26094 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.579241 25814 catalog_manager.cc:5484] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 6 to 7, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.580526 26491 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.582787 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet f81a35dbe00342f89c4a42a3cfbbeacc with delete_type TABLET_DATA_TOMBSTONED (TS b4908484400a4ce2aea341e9e1bdced3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:35780
I20240502 20:47:14.584822 28275 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.585276 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.585405 26757 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.585897 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.586169 29048 raft_consensus.cc:1050] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:14.586691 29048 consensus_queue.cc:237] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:14.587486 26094 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.587539 25962 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.588214 28642 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.589246 26623 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.589555 27825 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.589718 26757 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.590082 29050 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.590251 27825 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.590902 29059 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.591387 26359 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.592207 29050 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.592278 26491 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.592324 25965 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.592669 26623 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.592953 26228 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.593355 29059 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.594451 28406 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.594657 26094 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.594597 26491 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.595135 29049 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.595142 26094 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.595482 29049 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.597143 25965 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.598084 26492 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.598738 28275 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.598856 25817 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.599646 26227 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.599689 28967 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.600001 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 679352ffb9884583a0f1ee092d4badb1 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:14.600643 28967 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.602048 28967 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.601987 26757 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.606334 26341 tablet_service.cc:1514] Processing DeleteTablet for tablet 679352ffb9884583a0f1ee092d4badb1 with delete_type TABLET_DATA_TOMBSTONED (TS bbee1301f7b94c6ab339ecaccc4ce740 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56420
I20240502 20:47:14.606396 29049 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.607765 26227 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.608047 28406 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.609148 25965 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.610359 26757 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.611200 25822 catalog_manager.cc:5484] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:14.611811 26493 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.614341 26359 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.617233 29085 tablet_replica.cc:330] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3: stopping tablet replica
I20240502 20:47:14.617713 29085 raft_consensus.cc:2229] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:14.618438 26096 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.618822 29085 raft_consensus.cc:2258] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:14.619176 29094 tablet_replica.cc:330] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740: stopping tablet replica
I20240502 20:47:14.619519 29094 raft_consensus.cc:2229] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:14.620296 29085 ts_tablet_manager.cc:1875] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:14.619822 29094 raft_consensus.cc:2258] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:14.623883 26623 consensus_queue.cc:237] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:14.625422 29094 ts_tablet_manager.cc:1875] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:14.625597 25965 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.625880 26228 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.626003 26096 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.626055 26757 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.626096 26359 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.626401 28406 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.626363 28968 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.626569 29047 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.626829 28603 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.627146 28603 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.630601 29094 ts_tablet_manager.cc:1888] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:14.630713 29094 log.cc:1196] T 679352ffb9884583a0f1ee092d4badb1 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/679352ffb9884583a0f1ee092d4badb1
I20240502 20:47:14.631979 25809 catalog_manager.cc:4830] TS bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): tablet 679352ffb9884583a0f1ee092d4badb1 (table rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]) successfully deleted
I20240502 20:47:14.632278 29047 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.632640 29047 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.633913 29085 ts_tablet_manager.cc:1888] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:14.634018 29085 log.cc:1196] T f81a35dbe00342f89c4a42a3cfbbeacc P b4908484400a4ce2aea341e9e1bdced3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/wals/f81a35dbe00342f89c4a42a3cfbbeacc
I20240502 20:47:14.634881 25810 catalog_manager.cc:4830] TS b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673): tablet f81a35dbe00342f89c4a42a3cfbbeacc (table rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]) successfully deleted
I20240502 20:47:14.636030 25962 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.636106 28603 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.636440 26359 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.638271 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 23d260f1c3be4dd1b18fc82af355c137 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:14.638640 25821 catalog_manager.cc:5484] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.638777 26757 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.638945 26094 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.641321 26228 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.642016 28406 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.645251 26471 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d260f1c3be4dd1b18fc82af355c137 with delete_type TABLET_DATA_TOMBSTONED (TS 9aaa16c4fc46478f90a3d97b010330c2 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:37788
I20240502 20:47:14.646158 29101 tablet_replica.cc:330] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2: stopping tablet replica
I20240502 20:47:14.646518 29101 raft_consensus.cc:2229] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:14.646879 29101 raft_consensus.cc:2258] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:14.647924 28697 raft_consensus.cc:1050] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:14.648442 27825 raft_consensus.cc:1050] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:14.648504 28697 consensus_queue.cc:237] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:14.648936 27825 consensus_queue.cc:237] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:14.649178 29101 ts_tablet_manager.cc:1875] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:14.650983 26493 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.651018 25965 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.651104 26094 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.651192 28406 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.651463 26623 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.651463 29060 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.651648 28638 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.652000 28638 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.652649 26756 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.652731 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.653518 29101 ts_tablet_manager.cc:1888] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:14.653656 29101 log.cc:1196] T 23d260f1c3be4dd1b18fc82af355c137 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/23d260f1c3be4dd1b18fc82af355c137
I20240502 20:47:14.653745 28275 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.654068 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.654256 25965 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.654668 26757 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.655313 26228 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.655480 29057 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.655617 27825 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.655797 29107 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.656702 26625 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.657013 26491 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.657812 26359 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.658232 28642 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.658583 27825 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.659304 25809 catalog_manager.cc:4830] TS 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495): tablet 23d260f1c3be4dd1b18fc82af355c137 (table rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]) successfully deleted
I20240502 20:47:14.659313 29103 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.660319 26361 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.660677 29103 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.661867 28467 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.662110 29106 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.663996 29060 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.665136 26757 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.666383 26094 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.666469 25965 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.666970 26361 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.667102 28467 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.667958 28406 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.669389 25962 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.669471 28275 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.671494 26757 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.673306 26625 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.673379 25814 catalog_manager.cc:5484] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.673570 25822 catalog_manager.cc:5484] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.673307 26623 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.676757 26228 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.676757 26493 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.677940 26361 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.686129 26491 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.690773 26228 consensus_queue.cc:237] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:14.691037 26094 consensus_queue.cc:237] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:14.692901 26757 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.693135 25965 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.693367 28638 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.693465 28275 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.693538 28406 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.694069 26228 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.694423 26623 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.694490 28638 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.694551 25965 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.694581 26756 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.695237 26493 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.695304 29056 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.695585 28697 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.695966 26094 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.696038 29059 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.696264 29104 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.697425 29059 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.696601 29104 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20240502 20:47:14.698407 29107 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.699288 28638 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.699611 26623 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.700147 25965 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.700452 28697 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.702122 26094 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.702184 26755 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.702457 28697 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.705480 26625 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.705729 26227 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.706568 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6a6052089aac4ad79f71a50b97c3debf with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:14.707782 26623 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.708443 25822 catalog_manager.cc:5484] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.708618 26755 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.709148 28406 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.710695 26491 raft_consensus.cc:1261] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.710638 28275 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.711140 29104 consensus_queue.cc:1035] T 6a6052089aac4ad79f71a50b97c3debf P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.711189 29061 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.711871 25965 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.712713 26491 raft_consensus.cc:2932] T 6a6052089aac4ad79f71a50b97c3debf P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.713194 26493 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.713358 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 00bf11a3e1c24449bba6a09d4ab280b0 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:14.714116 25818 catalog_manager.cc:5484] T 6a6052089aac4ad79f71a50b97c3debf P cc2b212930b84db1bb56f6952197955d reported cstate change: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.716861 26341 tablet_service.cc:1514] Processing DeleteTablet for tablet 00bf11a3e1c24449bba6a09d4ab280b0 with delete_type TABLET_DATA_TOMBSTONED (TS bbee1301f7b94c6ab339ecaccc4ce740 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56420
I20240502 20:47:14.717088 29094 tablet_replica.cc:330] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740: stopping tablet replica
I20240502 20:47:14.717221 29094 raft_consensus.cc:2229] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:14.717406 29094 raft_consensus.cc:2258] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:14.718065 26341 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a6052089aac4ad79f71a50b97c3debf with delete_type TABLET_DATA_TOMBSTONED (TS bbee1301f7b94c6ab339ecaccc4ce740 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56420
I20240502 20:47:14.719023 29094 ts_tablet_manager.cc:1875] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:14.722468 29094 ts_tablet_manager.cc:1888] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:14.722548 29094 log.cc:1196] T 00bf11a3e1c24449bba6a09d4ab280b0 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/00bf11a3e1c24449bba6a09d4ab280b0
I20240502 20:47:14.722957 29094 tablet_replica.cc:330] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740: stopping tablet replica
I20240502 20:47:14.723069 29094 raft_consensus.cc:2229] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:14.723127 25809 catalog_manager.cc:4830] TS bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): tablet 00bf11a3e1c24449bba6a09d4ab280b0 (table rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]) successfully deleted
I20240502 20:47:14.723218 29094 raft_consensus.cc:2258] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:14.724289 29094 ts_tablet_manager.cc:1875] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:14.726189 29094 ts_tablet_manager.cc:1888] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:14.726274 29094 log.cc:1196] T 6a6052089aac4ad79f71a50b97c3debf P bbee1301f7b94c6ab339ecaccc4ce740: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/6a6052089aac4ad79f71a50b97c3debf
I20240502 20:47:14.726846 25809 catalog_manager.cc:4830] TS bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): tablet 6a6052089aac4ad79f71a50b97c3debf (table rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]) successfully deleted
I20240502 20:47:14.782366 28630 raft_consensus.cc:1050] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:14.782923 28630 consensus_queue.cc:237] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:14.785001 26623 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.785156 26755 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.785526 26094 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.785647 26491 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.785701 25965 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.786182 28406 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.786257 26227 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.786406 28679 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.786578 29136 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.786698 29137 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.786916 29135 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.787123 29138 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.787277 28630 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.788023 28682 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.790920 28682 raft_consensus.cc:1050] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:14.791491 28682 consensus_queue.cc:237] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:14.792143 29137 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.793072 26227 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.793468 26094 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.793756 26756 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.795948 28406 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.796548 26623 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.798053 26493 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.798012 26491 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.798200 26227 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.798031 25814 catalog_manager.cc:5484] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.798569 29137 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.798892 29137 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.799221 28406 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.800034 25962 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.800136 25965 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.800674 26094 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.801072 29150 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.801458 29150 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.801980 26756 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.803773 29149 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.804703 26623 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.805132 29149 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.805930 29149 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.806211 26361 consensus_queue.cc:237] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:14.809142 28407 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.809296 26094 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.809590 26623 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.809764 29150 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.810225 25965 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.810178 29147 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.810415 29150 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.810587 29147 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.810868 26228 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.811034 26491 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.812037 29151 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.813704 26755 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.813947 26625 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.814211 26094 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.814324 25962 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.816244 28407 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.816442 29152 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.816532 25821 catalog_manager.cc:5484] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:14.819291 29137 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.820161 29151 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.820456 26756 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.820608 26755 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.821626 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 406675832bd84f4ea6de10c0ae14ec53 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:14.821835 25965 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.823427 26094 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.823427 26228 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.823868 26227 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.826153 26623 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.826318 25815 catalog_manager.cc:5484] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.827454 28407 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.830582 26471 tablet_service.cc:1514] Processing DeleteTablet for tablet 406675832bd84f4ea6de10c0ae14ec53 with delete_type TABLET_DATA_TOMBSTONED (TS 9aaa16c4fc46478f90a3d97b010330c2 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:37788
I20240502 20:47:14.830825 29101 tablet_replica.cc:330] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: stopping tablet replica
I20240502 20:47:14.830991 29101 raft_consensus.cc:2229] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:14.831171 29101 raft_consensus.cc:2258] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:14.831960 29101 ts_tablet_manager.cc:1875] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:14.832513 26361 consensus_queue.cc:237] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:14.834107 29101 ts_tablet_manager.cc:1888] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:14.834179 29101 log.cc:1196] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/406675832bd84f4ea6de10c0ae14ec53
I20240502 20:47:14.834859 26227 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.835124 25809 catalog_manager.cc:4830] TS 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495): tablet 406675832bd84f4ea6de10c0ae14ec53 (table rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]) successfully deleted
I20240502 20:47:14.835397 26491 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.835654 29150 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.835817 25965 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.836158 29152 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.836236 26755 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.836256 26094 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.836623 28407 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.836674 29150 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.837014 29150 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.837538 29150 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.837932 29136 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.839587 29150 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.840359 28407 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.840940 25965 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.841457 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e25072f604644d9595c95c1bd5bfd7db with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:14.841439 26755 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.842243 26491 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.842525 26094 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.843232 26227 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.844719 25821 catalog_manager.cc:5484] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:14.848284 26604 tablet_service.cc:1514] Processing DeleteTablet for tablet e25072f604644d9595c95c1bd5bfd7db with delete_type TABLET_DATA_TOMBSTONED (TS 4855f9c9a7f64986b4a0eb21e1ef6f0a not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:60510
I20240502 20:47:14.850647 29162 tablet_replica.cc:330] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a: stopping tablet replica
I20240502 20:47:14.851073 29162 raft_consensus.cc:2229] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:14.851322 29162 raft_consensus.cc:2258] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:14.852485 29162 ts_tablet_manager.cc:1875] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:14.854493 29162 ts_tablet_manager.cc:1888] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:14.854593 29162 log.cc:1196] T e25072f604644d9595c95c1bd5bfd7db P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/wals/e25072f604644d9595c95c1bd5bfd7db
I20240502 20:47:14.855155 25808 catalog_manager.cc:4830] TS 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815): tablet e25072f604644d9595c95c1bd5bfd7db (table rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]) successfully deleted
I20240502 20:47:14.907157 28697 raft_consensus.cc:1050] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701: attempting to promote NON_VOTER 706762b60f514a048c4935e359027441 to VOTER
I20240502 20:47:14.907712 28697 consensus_queue.cc:237] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:14.909987 26623 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.910403 28697 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.911003 26755 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.911114 25965 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.911567 29107 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.911655 28145 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.911749 28697 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.912304 26491 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.912321 26227 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.912643 29106 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.912781 28697 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.913193 29107 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.914917 26361 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.915382 29107 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.917127 29106 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.917483 26227 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.917789 26361 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.920048 25965 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.920310 26491 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.920647 25814 catalog_manager.cc:5484] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.922520 26755 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.923266 28145 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.924971 28697 raft_consensus.cc:1050] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:14.924947 26623 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.925493 28697 consensus_queue.cc:237] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:14.927498 26623 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.928028 29105 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.928206 28275 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.928638 29106 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.929186 25965 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.929646 26755 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.929926 28467 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.931991 28697 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.933244 26094 consensus_queue.cc:237] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:14.933367 26227 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.934623 29107 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.934928 26361 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.934993 29103 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.935289 26491 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:14.935387 28145 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.936175 29105 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.936396 28467 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:14.936751 26227 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.937357 25965 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.937446 28275 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.938935 26623 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.939164 26491 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.940613 29103 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.940737 26228 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.941170 29103 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.941104 26361 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.942268 25821 catalog_manager.cc:5484] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:14.942286 26756 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:14.942633 26359 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.943356 26493 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.944408 26755 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.944753 29105 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.945470 25965 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:14.945526 29107 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.945922 29107 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.947005 29103 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:14.948043 28697 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.948829 26493 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.949620 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ec36083ee0ce441c9b2337a48d41a5fc with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:14.950359 26227 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.951459 26755 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.951534 28145 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.954819 25965 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.954918 25823 catalog_manager.cc:5484] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.958686 26604 tablet_service.cc:1514] Processing DeleteTablet for tablet ec36083ee0ce441c9b2337a48d41a5fc with delete_type TABLET_DATA_TOMBSTONED (TS 4855f9c9a7f64986b4a0eb21e1ef6f0a not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:60510
I20240502 20:47:14.958953 29162 tablet_replica.cc:330] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: stopping tablet replica
I20240502 20:47:14.959126 29162 raft_consensus.cc:2229] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:14.959331 29162 raft_consensus.cc:2258] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:14.959441 26361 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:14.960085 29162 ts_tablet_manager.cc:1875] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:14.962191 29162 ts_tablet_manager.cc:1888] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:14.962280 29162 log.cc:1196] T ec36083ee0ce441c9b2337a48d41a5fc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/wals/ec36083ee0ce441c9b2337a48d41a5fc
I20240502 20:47:14.962949 25808 catalog_manager.cc:4830] TS 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815): tablet ec36083ee0ce441c9b2337a48d41a5fc (table rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]) successfully deleted
I20240502 20:47:14.967964 25965 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:14.969852 26094 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:14.969852 26623 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:14.969985 26227 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:14.970141 26361 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:14.970242 26755 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:14.970466 29187 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:14.970701 28680 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:14.970849 26491 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:14.970973 29128 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:14.971109 28680 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:14.971282 29186 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:14.972481 29186 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:14.974908 26623 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:14.975030 26491 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:14.975083 29186 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:14.975950 26755 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:14.978075 25822 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:14.979266 26228 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:14.980425 26361 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:14.980619 26094 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:14.987119 25965 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:14.989387 26094 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:14.989423 26227 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:14.989799 26361 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:14.989763 29186 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:14.990005 28680 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:14.990247 26623 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:14.990216 29188 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:14.990684 29187 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:14.991446 26755 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:14.991539 26491 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:14.991972 29186 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:14.992152 29128 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:14.995106 29188 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:14.995501 26227 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:14.996121 29020 raft_consensus.cc:1050] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: attempting to promote NON_VOTER 706762b60f514a048c4935e359027441 to VOTER
I20240502 20:47:14.996490 26491 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:14.996703 29020 consensus_queue.cc:237] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:14.997051 26755 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:14.998669 26359 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
W20240502 20:47:15.000461 25901 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 706762b60f514a048c4935e359027441 (127.9.82.136:41039): Couldn't send request to peer 706762b60f514a048c4935e359027441. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cacd9a8959094a24b6f7572e973ef71f. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:15.000766 28145 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:15.001192 25810 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet cacd9a8959094a24b6f7572e973ef71f with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:15.001188 28663 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:15.001695 26094 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:15.001760 26359 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:15.002153 25965 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:15.002280 26227 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:15.002450 28663 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:15.002285 26625 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.002821 26491 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:15.002821 28663 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:15.003320 28663 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:15.003643 28663 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:15.004146 29004 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:15.005079 26623 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:15.005276 25818 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.005568 29004 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:15.011034 26094 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.011545 29203 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.014472 28145 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.016089 26094 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.016162 26625 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.016391 26361 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.016494 25965 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.017882 26227 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.015627 26493 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.019840 25823 catalog_manager.cc:5484] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.024760 26755 consensus_queue.cc:237] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:15.026551 28145 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.026813 25965 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.027207 26227 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.027176 29207 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.027357 28663 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.027583 28663 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.027812 26361 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.028218 26493 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.028951 29207 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.029302 29207 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.027047 26094 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.030265 29004 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.030748 29020 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.031320 26227 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.032620 26361 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.032994 25810 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 50134092a82f42b08ffacf2eff58b0f9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:15.033077 26096 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.033329 28145 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.033515 25965 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.036085 25823 catalog_manager.cc:5484] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.037793 26493 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:15.042068 26604 tablet_service.cc:1514] Processing DeleteTablet for tablet 50134092a82f42b08ffacf2eff58b0f9 with delete_type TABLET_DATA_TOMBSTONED (TS 4855f9c9a7f64986b4a0eb21e1ef6f0a not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:60510
I20240502 20:47:15.042373 29162 tablet_replica.cc:330] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: stopping tablet replica
I20240502 20:47:15.042549 29162 raft_consensus.cc:2229] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:15.042737 29162 raft_consensus.cc:2258] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:15.043551 29162 ts_tablet_manager.cc:1875] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:15.045444 29162 ts_tablet_manager.cc:1888] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:15.045512 29162 log.cc:1196] T 50134092a82f42b08ffacf2eff58b0f9 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/wals/50134092a82f42b08ffacf2eff58b0f9
I20240502 20:47:15.046031 25808 catalog_manager.cc:4830] TS 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815): tablet 50134092a82f42b08ffacf2eff58b0f9 (table rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]) successfully deleted
I20240502 20:47:15.301995 26493 consensus_queue.cc:237] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:15.303694 26227 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.304143 25965 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.304168 29160 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.304556 26756 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.304613 26361 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.304924 26094 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.305166 26625 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.305409 29263 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.305644 29160 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.305963 29160 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.306211 28010 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.307097 28010 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.309358 28010 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.310410 26094 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.312155 26625 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.313071 25814 catalog_manager.cc:5484] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.313146 26227 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.315642 25965 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.317456 26361 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.319516 26493 consensus_queue.cc:237] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:15.322284 26625 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.322422 25965 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.322650 29263 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.323750 29278 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.324241 26756 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.324925 26361 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.325340 29263 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.325830 29263 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.326655 26094 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.326743 26756 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.327358 29263 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.328064 26227 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.329157 29263 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.331944 26624 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:15.331815 29263 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.332966 25965 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.334012 26361 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.334564 26096 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.335266 26493 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.335368 28603 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.335594 25965 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.336208 26359 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.336267 25823 catalog_manager.cc:5484] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.336927 25809 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 51586991cf25422681e1f758f6b7c52d with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:15.337270 26756 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.337366 26227 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.337684 26624 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.338979 28603 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.339335 28603 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.339633 28603 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.339452 26227 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.339972 28603 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.340263 28603 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.341583 26756 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
W20240502 20:47:15.347154 26426 consensus_peers.cc:485] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51586991cf25422681e1f758f6b7c52d. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:15.348426 29284 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.348757 26755 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.349015 25965 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.352589 26227 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.352602 25814 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.352809 26359 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.357924 26624 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.362027 26227 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.362223 25965 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.362275 26755 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.362903 29283 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 20:47:15.363077 26561 consensus_peers.cc:485] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 706762b60f514a048c4935e359027441 (127.9.82.136:41039): Couldn't send request to peer 706762b60f514a048c4935e359027441. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8659718d503141fa8a8024b700683858. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:15.363282 29282 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.363498 29283 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.364909 26094 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.365571 26359 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.365939 29283 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.369222 29285 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.370293 26491 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.370744 26095 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.370730 26359 consensus_queue.cc:237] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:15.370990 25808 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 8659718d503141fa8a8024b700683858 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:15.371562 29286 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.371665 26361 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.371845 26227 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.372349 26095 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.373056 25962 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.373507 29150 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.373919 26095 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.374560 26624 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.374506 25965 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.374945 25814 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.375321 26096 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.376042 29136 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.376406 29136 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.376856 26756 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.377892 26227 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.378428 29150 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.378494 26755 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.378866 29285 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.380112 29300 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.380677 26491 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.381819 29150 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.382844 29150 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.383392 26491 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.383373 26755 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.384848 26491 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.385226 26624 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.386674 26227 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.387598 25962 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.388221 26096 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.392575 26096 consensus_queue.cc:237] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:15.395036 25818 catalog_manager.cc:5484] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.395385 28275 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.395910 29106 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.396310 26755 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.396414 25965 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.396819 28697 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.397008 26624 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.397083 28697 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.397697 29106 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.399454 28697 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:15.402082 26227 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.402432 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f9f56f646f94461ab85acea3efdc14f4 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:15.402370 26624 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:15.402941 26361 raft_consensus.cc:1261] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:15.403748 28698 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.403868 29105 consensus_queue.cc:1035] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:15.404094 25815 catalog_manager.cc:5484] T f9f56f646f94461ab85acea3efdc14f4 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:15.405244 26227 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:15.405247 28275 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:15.407394 26755 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:15.410576 26493 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.412173 26361 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:15.414199 25962 raft_consensus.cc:2932] T f9f56f646f94461ab85acea3efdc14f4 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:15.415627 26471 tablet_service.cc:1514] Processing DeleteTablet for tablet f9f56f646f94461ab85acea3efdc14f4 with delete_type TABLET_DATA_TOMBSTONED (TS 9aaa16c4fc46478f90a3d97b010330c2 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:37788
I20240502 20:47:15.417026 29313 tablet_replica.cc:330] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2: stopping tablet replica
I20240502 20:47:15.417253 29313 raft_consensus.cc:2229] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:15.418357 26096 consensus_queue.cc:237] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:15.418802 26361 consensus_queue.cc:237] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.420451 26359 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.420568 26624 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.420912 26755 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.421195 26493 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.421972 26228 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.421993 26095 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.422133 28698 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.422505 28698 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.422727 25962 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.422765 26624 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.422824 28698 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.423040 29151 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.423327 29313 raft_consensus.cc:2258] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:15.423599 28630 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.423800 29300 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.424284 29313 ts_tablet_manager.cc:1875] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:15.424508 29151 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.424803 25962 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.425069 26227 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.425199 29105 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.425750 28698 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.426079 28698 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.427822 29313 ts_tablet_manager.cc:1888] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:15.428045 29313 log.cc:1196] T f9f56f646f94461ab85acea3efdc14f4 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/f9f56f646f94461ab85acea3efdc14f4
I20240502 20:47:15.428728 26491 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.428680 29300 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.429154 29151 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.430009 29105 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.430279 26228 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.430907 26624 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.431311 25809 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet d8efe0d8a46e47a59900e07e6430cd37 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:15.432690 25962 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.432797 26756 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.435863 26493 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.437093 26491 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.438020 26096 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.438361 25823 catalog_manager.cc:5484] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.440286 25819 catalog_manager.cc:5484] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.440477 26359 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.434509 25809 catalog_manager.cc:4830] TS 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495): tablet f9f56f646f94461ab85acea3efdc14f4 (table rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]) successfully deleted
I20240502 20:47:15.442451 26227 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.444301 26624 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.445803 26755 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.446236 29136 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 20:47:15.447479 26297 consensus_peers.cc:485] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 706762b60f514a048c4935e359027441 (127.9.82.136:41039): Couldn't send request to peer 706762b60f514a048c4935e359027441. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8efe0d8a46e47a59900e07e6430cd37. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:15.447371 25962 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.449433 26755 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.453557 29326 ts_tablet_manager.cc:902] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: Initiating tablet copy from peer 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129)
I20240502 20:47:15.454191 29326 tablet_copy_client.cc:308] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:37129
I20240502 20:47:15.454119 26096 consensus_queue.cc:237] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.456513 25962 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.456513 26359 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.456645 26227 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20240502 20:47:15.456779 26033 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 706762b60f514a048c4935e359027441 (127.9.82.136:41039): Couldn't send request to peer 706762b60f514a048c4935e359027441. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 441da21c8ff8492c88c752ebf1233857. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:15.456936 29106 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.457149 26491 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.457309 29106 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.457651 26625 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.458146 28698 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.458375 29106 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.459070 26755 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.460315 28698 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.460726 28698 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.460763 25985 tablet_copy_service.cc:140] P 3c6dc91a7df244ab82c1161799ba2ff3: Received BeginTabletCopySession request for tablet cacd9a8959094a24b6f7572e973ef71f from peer 706762b60f514a048c4935e359027441 ({username='slave'} at 127.9.82.136:39923)
I20240502 20:47:15.460896 25985 tablet_copy_service.cc:161] P 3c6dc91a7df244ab82c1161799ba2ff3: Beginning new tablet copy session on tablet cacd9a8959094a24b6f7572e973ef71f from peer 706762b60f514a048c4935e359027441 at {username='slave'} at 127.9.82.136:39923: session id = 706762b60f514a048c4935e359027441-cacd9a8959094a24b6f7572e973ef71f
I20240502 20:47:15.462482 25985 tablet_copy_source_session.cc:205] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:15.462565 29106 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.462934 26625 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.463523 26756 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.465638 25808 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 441da21c8ff8492c88c752ebf1233857 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:15.466192 29326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:15.466121 26227 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.467819 26359 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.468138 25817 catalog_manager.cc:5484] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:15.468693 29326 tablet_copy_client.cc:783] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:15.468860 29326 tablet_copy_client.cc:647] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:15.469563 25962 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.471364 29326 tablet_copy_client.cc:523] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:15.472775 29326 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: Bootstrap starting.
I20240502 20:47:15.475709 26491 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:15.478200 26625 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.478276 26096 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.478677 29264 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.479336 29264 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.480350 26228 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.481245 29264 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.481447 26359 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.482194 29264 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.482071 26491 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.485512 26755 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.485945 29264 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.487417 25962 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.487823 29264 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.488168 29278 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.488574 26755 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.491011 25962 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.492184 25814 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.493594 26228 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.494551 26096 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.496974 26359 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.501370 26625 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:15.503295 26493 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.503872 29326 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:15.504182 29326 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: Bootstrap complete.
I20240502 20:47:15.504364 29326 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: Time spent bootstrapping tablet: real 0.032s user 0.026s sys 0.000s
I20240502 20:47:15.505070 29326 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.505203 29326 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 706762b60f514a048c4935e359027441, State: Initialized, Role: LEARNER
I20240502 20:47:15.505312 29326 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.507091 29326 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 20:47:15.507648 25985 tablet_copy_service.cc:342] P 3c6dc91a7df244ab82c1161799ba2ff3: Request end of tablet copy session 706762b60f514a048c4935e359027441-cacd9a8959094a24b6f7572e973ef71f received from {username='slave'} at 127.9.82.136:39923
I20240502 20:47:15.507805 25985 tablet_copy_service.cc:433] P 3c6dc91a7df244ab82c1161799ba2ff3: ending tablet copy session 706762b60f514a048c4935e359027441-cacd9a8959094a24b6f7572e973ef71f on tablet cacd9a8959094a24b6f7572e973ef71f with peer 706762b60f514a048c4935e359027441
I20240502 20:47:15.509142 26755 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.509608 26096 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.509753 25962 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.509819 26228 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.510124 29278 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.510337 29160 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.510843 26361 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.510821 29263 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.511337 29263 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.511687 29263 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 20:47:15.514389 26429 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 706762b60f514a048c4935e359027441 (127.9.82.136:41039): Couldn't send request to peer 706762b60f514a048c4935e359027441. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adb68aca646d42b2a869eaab1e3e805b. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:15.515324 26625 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.515749 29160 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.516043 29277 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.516525 26228 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.517060 26625 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.517756 25809 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet adb68aca646d42b2a869eaab1e3e805b with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:15.518592 26095 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.518834 26755 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.519333 25819 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:15.524173 26361 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.528709 26755 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:15.530460 26096 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.530608 26361 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.530627 25965 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.531054 26228 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.531069 29020 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.531419 29020 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.531582 29203 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.531770 29204 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.532199 25965 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.532802 26625 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.534224 26493 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.534214 29204 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.534834 29204 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.537856 29204 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.538343 26493 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.540509 26096 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.541136 25822 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:15.542119 25965 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.542153 26361 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.547673 26755 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.547658 26625 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
W20240502 20:47:15.549979 26693 consensus_peers.cc:485] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 -> Peer 706762b60f514a048c4935e359027441 (127.9.82.136:41039): Couldn't send request to peer 706762b60f514a048c4935e359027441. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51a63a79b0ee42aba9fc7bf8e8c7428e. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:15.550377 25965 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.550932 26096 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.551333 29020 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.551571 26493 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.551955 26361 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.551971 29204 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.552479 26228 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.553529 29207 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.553685 26625 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.553870 29203 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.553989 29020 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.554308 29020 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.554435 26228 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.557981 29204 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.559338 25810 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:15.560653 25965 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.561321 26096 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.561815 26361 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.562367 26493 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.565568 25814 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:15.566289 26625 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.567353 26228 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 706762b60f514a048c4935e359027441 (127.9.82.136) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } } }
I20240502 20:47:15.807571 29326 ts_tablet_manager.cc:902] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: Initiating tablet copy from peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125)
I20240502 20:47:15.808125 29326 tablet_copy_client.cc:308] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:43125
I20240502 20:47:15.811658 26381 tablet_copy_service.cc:140] P bbee1301f7b94c6ab339ecaccc4ce740: Received BeginTabletCopySession request for tablet d8efe0d8a46e47a59900e07e6430cd37 from peer 706762b60f514a048c4935e359027441 ({username='slave'} at 127.9.82.136:32845)
I20240502 20:47:15.811800 26381 tablet_copy_service.cc:161] P bbee1301f7b94c6ab339ecaccc4ce740: Beginning new tablet copy session on tablet d8efe0d8a46e47a59900e07e6430cd37 from peer 706762b60f514a048c4935e359027441 at {username='slave'} at 127.9.82.136:32845: session id = 706762b60f514a048c4935e359027441-d8efe0d8a46e47a59900e07e6430cd37
I20240502 20:47:15.812556 26381 tablet_copy_source_session.cc:205] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:15.813407 29326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8efe0d8a46e47a59900e07e6430cd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:15.815059 29326 tablet_copy_client.cc:783] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:15.815237 29326 tablet_copy_client.cc:647] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:15.816406 29326 tablet_copy_client.cc:523] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:15.817377 29326 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: Bootstrap starting.
I20240502 20:47:15.829346 26361 consensus_queue.cc:237] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:15.831051 26755 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.831110 26228 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.831521 28630 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.831662 25965 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.831904 28630 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.832608 26625 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.833042 26096 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.833487 29150 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.834333 29136 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.834676 29136 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.835644 29407 ts_tablet_manager.cc:902] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: Initiating tablet copy from peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:15.836354 29407 tablet_copy_client.cc:308] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.134:39815
I20240502 20:47:15.837522 26645 tablet_copy_service.cc:140] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Received BeginTabletCopySession request for tablet 8659718d503141fa8a8024b700683858 from peer 706762b60f514a048c4935e359027441 ({username='slave'} at 127.9.82.136:60391)
I20240502 20:47:15.837635 26645 tablet_copy_service.cc:161] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Beginning new tablet copy session on tablet 8659718d503141fa8a8024b700683858 from peer 706762b60f514a048c4935e359027441 at {username='slave'} at 127.9.82.136:60391: session id = 706762b60f514a048c4935e359027441-8659718d503141fa8a8024b700683858
I20240502 20:47:15.838317 26645 tablet_copy_source_session.cc:205] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:15.839197 29407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:15.839200 29150 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.839424 26493 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:15.839886 29151 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.841044 26493 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.841457 29407 tablet_copy_client.cc:783] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:15.841619 29407 tablet_copy_client.cc:647] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:15.842258 26755 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.842160 26228 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.843155 26096 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.845360 25817 catalog_manager.cc:5484] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } }
I20240502 20:47:15.845651 29326 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:15.845911 29326 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: Bootstrap complete.
I20240502 20:47:15.846460 29326 ts_tablet_manager.cc:1367] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: Time spent bootstrapping tablet: real 0.029s user 0.027s sys 0.000s
I20240502 20:47:15.846982 29326 raft_consensus.cc:348] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.847117 29326 raft_consensus.cc:729] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 706762b60f514a048c4935e359027441, State: Initialized, Role: LEARNER
I20240502 20:47:15.847245 29326 consensus_queue.cc:260] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.847797 29326 ts_tablet_manager.cc:1398] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:15.849504 26381 tablet_copy_service.cc:342] P bbee1301f7b94c6ab339ecaccc4ce740: Request end of tablet copy session 706762b60f514a048c4935e359027441-d8efe0d8a46e47a59900e07e6430cd37 received from {username='slave'} at 127.9.82.136:32845
I20240502 20:47:15.849601 26381 tablet_copy_service.cc:433] P bbee1301f7b94c6ab339ecaccc4ce740: ending tablet copy session 706762b60f514a048c4935e359027441-d8efe0d8a46e47a59900e07e6430cd37 on tablet d8efe0d8a46e47a59900e07e6430cd37 with peer 706762b60f514a048c4935e359027441
I20240502 20:47:15.854053 26361 consensus_queue.cc:237] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:15.857564 26228 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.857940 29136 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.858099 29407 tablet_copy_client.cc:523] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:15.859078 26755 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.859484 26096 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.859578 26625 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.860203 28630 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.860502 28630 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.860564 26493 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.860832 29407 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: Bootstrap starting.
I20240502 20:47:15.860951 29300 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.860998 26625 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.861388 29300 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:15.863317 25965 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:15.864303 29150 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:15.865396 25965 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:15.866134 29300 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.866806 26228 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.868777 25809 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet d19c2fce372b4bbb936013051cc32978 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:15.869074 26493 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.869246 26625 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.869628 26755 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.871596 25965 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.873564 25817 catalog_manager.cc:5484] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 20:47:15.878159 26294 consensus_peers.cc:485] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d19c2fce372b4bbb936013051cc32978. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:15.881732 26096 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:15.911847 29407 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:15.912279 29407 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: Bootstrap complete.
I20240502 20:47:15.912519 29407 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: Time spent bootstrapping tablet: real 0.052s user 0.021s sys 0.007s
I20240502 20:47:15.913028 29407 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.913259 29407 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 706762b60f514a048c4935e359027441, State: Initialized, Role: LEARNER
I20240502 20:47:15.913399 29407 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.913770 29407 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:15.914343 26645 tablet_copy_service.cc:342] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Request end of tablet copy session 706762b60f514a048c4935e359027441-8659718d503141fa8a8024b700683858 received from {username='slave'} at 127.9.82.136:60391
I20240502 20:47:15.914436 26645 tablet_copy_service.cc:433] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: ending tablet copy session 706762b60f514a048c4935e359027441-8659718d503141fa8a8024b700683858 on tablet 8659718d503141fa8a8024b700683858 with peer 706762b60f514a048c4935e359027441
I20240502 20:47:15.934852 29407 ts_tablet_manager.cc:902] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: Initiating tablet copy from peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:15.935421 29407 tablet_copy_client.cc:308] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:34445
I20240502 20:47:15.936115 26116 tablet_copy_service.cc:140] P 73a41df730ef429d84fe648df03a2701: Received BeginTabletCopySession request for tablet 441da21c8ff8492c88c752ebf1233857 from peer 706762b60f514a048c4935e359027441 ({username='slave'} at 127.9.82.136:60197)
I20240502 20:47:15.936264 26116 tablet_copy_service.cc:161] P 73a41df730ef429d84fe648df03a2701: Beginning new tablet copy session on tablet 441da21c8ff8492c88c752ebf1233857 from peer 706762b60f514a048c4935e359027441 at {username='slave'} at 127.9.82.136:60197: session id = 706762b60f514a048c4935e359027441-441da21c8ff8492c88c752ebf1233857
I20240502 20:47:15.937196 26116 tablet_copy_source_session.cc:205] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:15.938243 29407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441da21c8ff8492c88c752ebf1233857. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:15.940112 29462 ts_tablet_manager.cc:902] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:15.940400 29407 tablet_copy_client.cc:783] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:15.940565 29407 tablet_copy_client.cc:647] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:15.941205 29462 tablet_copy_client.cc:308] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:37495
I20240502 20:47:15.942484 29407 tablet_copy_client.cc:523] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:15.943903 29407 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: Bootstrap starting.
I20240502 20:47:15.945938 26513 tablet_copy_service.cc:140] P 9aaa16c4fc46478f90a3d97b010330c2: Received BeginTabletCopySession request for tablet 51586991cf25422681e1f758f6b7c52d from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:37881)
I20240502 20:47:15.946156 26513 tablet_copy_service.cc:161] P 9aaa16c4fc46478f90a3d97b010330c2: Beginning new tablet copy session on tablet 51586991cf25422681e1f758f6b7c52d from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:37881: session id = cc2b212930b84db1bb56f6952197955d-51586991cf25422681e1f758f6b7c52d
I20240502 20:47:15.947378 26513 tablet_copy_source_session.cc:205] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:15.948803 29462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51586991cf25422681e1f758f6b7c52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:15.951179 29462 tablet_copy_client.cc:783] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:15.951346 29462 tablet_copy_client.cc:647] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:15.952996 29462 tablet_copy_client.cc:523] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:15.954404 29462 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:15.966989 29407 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:15.967890 29407 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: Bootstrap complete.
I20240502 20:47:15.968087 29407 ts_tablet_manager.cc:1367] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: Time spent bootstrapping tablet: real 0.024s user 0.017s sys 0.004s
I20240502 20:47:15.968503 29407 raft_consensus.cc:348] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.968623 29407 raft_consensus.cc:729] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 706762b60f514a048c4935e359027441, State: Initialized, Role: LEARNER
I20240502 20:47:15.968719 29407 consensus_queue.cc:260] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:15.968984 29407 ts_tablet_manager.cc:1398] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:15.969758 26116 tablet_copy_service.cc:342] P 73a41df730ef429d84fe648df03a2701: Request end of tablet copy session 706762b60f514a048c4935e359027441-441da21c8ff8492c88c752ebf1233857 received from {username='slave'} at 127.9.82.136:60197
I20240502 20:47:15.969841 26116 tablet_copy_service.cc:433] P 73a41df730ef429d84fe648df03a2701: ending tablet copy session 706762b60f514a048c4935e359027441-441da21c8ff8492c88c752ebf1233857 on tablet 441da21c8ff8492c88c752ebf1233857 with peer 706762b60f514a048c4935e359027441
I20240502 20:47:15.972761 28145 raft_consensus.cc:1203] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:15.978636 29462 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:15.978952 29462 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:15.979135 29462 ts_tablet_manager.cc:1367] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.005s
I20240502 20:47:15.979609 29462 raft_consensus.cc:348] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:15.979789 29462 raft_consensus.cc:729] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:15.979915 29462 consensus_queue.cc:260] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:15.980334 29462 ts_tablet_manager.cc:1398] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:47:15.981608 26513 tablet_copy_service.cc:342] P 9aaa16c4fc46478f90a3d97b010330c2: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-51586991cf25422681e1f758f6b7c52d received from {username='slave'} at 127.9.82.137:37881
I20240502 20:47:15.981734 26513 tablet_copy_service.cc:433] P 9aaa16c4fc46478f90a3d97b010330c2: ending tablet copy session cc2b212930b84db1bb56f6952197955d-51586991cf25422681e1f758f6b7c52d on tablet 51586991cf25422681e1f758f6b7c52d with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:16.084007 29407 ts_tablet_manager.cc:902] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: Initiating tablet copy from peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:16.084041 29326 ts_tablet_manager.cc:902] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: Initiating tablet copy from peer b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:16.084633 29407 tablet_copy_client.cc:308] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:37495
I20240502 20:47:16.084715 29326 tablet_copy_client.cc:308] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.135:39673
I20240502 20:47:16.085228 26777 tablet_copy_service.cc:140] P b4908484400a4ce2aea341e9e1bdced3: Received BeginTabletCopySession request for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e from peer 706762b60f514a048c4935e359027441 ({username='slave'} at 127.9.82.136:53103)
I20240502 20:47:16.085335 26777 tablet_copy_service.cc:161] P b4908484400a4ce2aea341e9e1bdced3: Beginning new tablet copy session on tablet 51a63a79b0ee42aba9fc7bf8e8c7428e from peer 706762b60f514a048c4935e359027441 at {username='slave'} at 127.9.82.136:53103: session id = 706762b60f514a048c4935e359027441-51a63a79b0ee42aba9fc7bf8e8c7428e
I20240502 20:47:16.086323 26777 tablet_copy_source_session.cc:205] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:16.087286 29326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:16.089644 29326 tablet_copy_client.cc:783] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:16.089704 26513 tablet_copy_service.cc:140] P 9aaa16c4fc46478f90a3d97b010330c2: Received BeginTabletCopySession request for tablet adb68aca646d42b2a869eaab1e3e805b from peer 706762b60f514a048c4935e359027441 ({username='slave'} at 127.9.82.136:34083)
I20240502 20:47:16.089803 29326 tablet_copy_client.cc:647] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:16.089820 26513 tablet_copy_service.cc:161] P 9aaa16c4fc46478f90a3d97b010330c2: Beginning new tablet copy session on tablet adb68aca646d42b2a869eaab1e3e805b from peer 706762b60f514a048c4935e359027441 at {username='slave'} at 127.9.82.136:34083: session id = 706762b60f514a048c4935e359027441-adb68aca646d42b2a869eaab1e3e805b
I20240502 20:47:16.090658 26513 tablet_copy_source_session.cc:205] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:16.091013 29326 tablet_copy_client.cc:523] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:16.092069 29326 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: Bootstrap starting.
I20240502 20:47:16.100317 29407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:16.102277 29407 tablet_copy_client.cc:783] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:16.102806 29407 tablet_copy_client.cc:647] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:16.106142 29407 tablet_copy_client.cc:523] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:16.107409 29407 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: Bootstrap starting.
I20240502 20:47:16.115988 29326 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:16.116281 29326 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: Bootstrap complete.
I20240502 20:47:16.116468 29326 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: Time spent bootstrapping tablet: real 0.024s user 0.019s sys 0.004s
I20240502 20:47:16.116976 29326 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:16.117123 29326 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 706762b60f514a048c4935e359027441, State: Initialized, Role: LEARNER
I20240502 20:47:16.117228 29326 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:16.117524 29326 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:16.118003 26777 tablet_copy_service.cc:342] P b4908484400a4ce2aea341e9e1bdced3: Request end of tablet copy session 706762b60f514a048c4935e359027441-51a63a79b0ee42aba9fc7bf8e8c7428e received from {username='slave'} at 127.9.82.136:53103
I20240502 20:47:16.118113 26777 tablet_copy_service.cc:433] P b4908484400a4ce2aea341e9e1bdced3: ending tablet copy session 706762b60f514a048c4935e359027441-51a63a79b0ee42aba9fc7bf8e8c7428e on tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with peer 706762b60f514a048c4935e359027441
I20240502 20:47:16.134100 29407 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:16.134354 29407 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: Bootstrap complete.
I20240502 20:47:16.134531 29407 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: Time spent bootstrapping tablet: real 0.027s user 0.019s sys 0.000s
I20240502 20:47:16.135016 29407 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:16.135154 29407 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 706762b60f514a048c4935e359027441, State: Initialized, Role: LEARNER
I20240502 20:47:16.135233 29407 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: NON_VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: true } }
I20240502 20:47:16.135488 29407 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:47:16.136077 26513 tablet_copy_service.cc:342] P 9aaa16c4fc46478f90a3d97b010330c2: Request end of tablet copy session 706762b60f514a048c4935e359027441-adb68aca646d42b2a869eaab1e3e805b received from {username='slave'} at 127.9.82.136:34083
I20240502 20:47:16.136185 26513 tablet_copy_service.cc:433] P 9aaa16c4fc46478f90a3d97b010330c2: ending tablet copy session 706762b60f514a048c4935e359027441-adb68aca646d42b2a869eaab1e3e805b on tablet adb68aca646d42b2a869eaab1e3e805b with peer 706762b60f514a048c4935e359027441
I20240502 20:47:16.258216 28144 raft_consensus.cc:1203] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:16.337783 29462 ts_tablet_manager.cc:902] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125)
I20240502 20:47:16.338325 29462 tablet_copy_client.cc:308] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:43125
I20240502 20:47:16.341957 26381 tablet_copy_service.cc:140] P bbee1301f7b94c6ab339ecaccc4ce740: Received BeginTabletCopySession request for tablet d19c2fce372b4bbb936013051cc32978 from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:56675)
I20240502 20:47:16.342067 26381 tablet_copy_service.cc:161] P bbee1301f7b94c6ab339ecaccc4ce740: Beginning new tablet copy session on tablet d19c2fce372b4bbb936013051cc32978 from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:56675: session id = cc2b212930b84db1bb56f6952197955d-d19c2fce372b4bbb936013051cc32978
I20240502 20:47:16.342945 26381 tablet_copy_source_session.cc:205] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:16.343820 29462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d19c2fce372b4bbb936013051cc32978. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:16.346220 29462 tablet_copy_client.cc:783] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:16.346376 29462 tablet_copy_client.cc:647] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:16.346684 28144 raft_consensus.cc:1203] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:16.349299 29462 tablet_copy_client.cc:523] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:16.350360 29462 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:16.368897 29462 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:16.369202 29462 tablet_bootstrap.cc:492] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:16.369359 29462 ts_tablet_manager.cc:1367] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.019s user 0.018s sys 0.000s
I20240502 20:47:16.369769 29462 raft_consensus.cc:348] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:16.369889 29462 raft_consensus.cc:729] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:16.369980 29462 consensus_queue.cc:260] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:16.370396 29462 ts_tablet_manager.cc:1398] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:16.370988 26381 tablet_copy_service.cc:342] P bbee1301f7b94c6ab339ecaccc4ce740: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-d19c2fce372b4bbb936013051cc32978 received from {username='slave'} at 127.9.82.137:56675
I20240502 20:47:16.371086 26381 tablet_copy_service.cc:433] P bbee1301f7b94c6ab339ecaccc4ce740: ending tablet copy session cc2b212930b84db1bb56f6952197955d-d19c2fce372b4bbb936013051cc32978 on tablet d19c2fce372b4bbb936013051cc32978 with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:16.378193 28275 raft_consensus.cc:1203] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:16.416039 29208 raft_consensus.cc:1050] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: attempting to promote NON_VOTER 706762b60f514a048c4935e359027441 to VOTER
I20240502 20:47:16.416716 29208 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:16.418725 26755 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.419355 26493 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.419422 26361 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.419443 28144 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.419978 29549 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.420258 29550 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.420419 26228 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.420886 29550 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.421847 26096 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.421847 26625 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.422245 29550 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.422751 29549 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.424504 29553 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.424891 29553 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.426029 29553 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.426333 26228 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.428215 26493 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.429827 25815 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.430711 26755 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.431116 26361 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.431870 28144 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.432827 26625 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.432873 26095 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.442816 25965 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:16.444494 28144 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.444800 26625 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.444800 26493 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.445047 26755 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.445173 26228 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.445267 26095 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.445530 29549 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.445752 29550 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.445891 29208 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.446014 29551 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.446151 29186 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.446473 29552 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.448833 29551 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.449474 28144 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.450034 26755 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.451040 25810 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet cacd9a8959094a24b6f7572e973ef71f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:16.452330 26493 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.452411 26095 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.453006 25817 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:16.454262 26228 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.457374 26341 tablet_service.cc:1514] Processing DeleteTablet for tablet cacd9a8959094a24b6f7572e973ef71f with delete_type TABLET_DATA_TOMBSTONED (TS bbee1301f7b94c6ab339ecaccc4ce740 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56420
I20240502 20:47:16.457880 29574 tablet_replica.cc:330] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: stopping tablet replica
I20240502 20:47:16.458200 29574 raft_consensus.cc:2229] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:16.458372 29574 raft_consensus.cc:2258] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:16.459307 29574 ts_tablet_manager.cc:1875] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:16.460034 26625 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.464587 29574 ts_tablet_manager.cc:1888] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:16.464666 29574 log.cc:1196] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/cacd9a8959094a24b6f7572e973ef71f
I20240502 20:47:16.465204 25809 catalog_manager.cc:4830] TS bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): tablet cacd9a8959094a24b6f7572e973ef71f (table rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]) successfully deleted
I20240502 20:47:16.477006 28144 raft_consensus.cc:1203] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:16.536944 28144 raft_consensus.cc:1203] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:16.678217 29151 raft_consensus.cc:1050] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740: attempting to promote NON_VOTER 706762b60f514a048c4935e359027441 to VOTER
I20240502 20:47:16.678819 29151 consensus_queue.cc:237] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:16.681315 26493 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.681437 26625 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.681896 29591 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.682238 28144 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.682350 25965 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.682828 26755 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.683295 29589 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.683450 29591 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.683501 26095 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.683501 26228 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.684264 29591 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.684866 29591 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.685514 29591 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.686211 29589 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.690984 26625 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.691176 29587 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.691668 25962 consensus_queue.cc:237] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:16.693519 26493 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.693876 26227 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:16.694120 26095 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.694901 26359 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:16.695042 26755 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.695572 28144 raft_consensus.cc:1203] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:16.695497 28145 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.696143 26096 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:16.697077 29553 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:16.698077 29553 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:16.698225 25817 catalog_manager.cc:5484] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.700367 26228 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.701435 26625 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:16.706290 26361 consensus_queue.cc:237] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:16.707990 26228 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.708104 28145 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.708282 26756 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.708458 29591 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.708642 29550 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:16.709060 29550 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:16.708282 26755 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:16.709281 29588 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.709606 29301 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.710261 26095 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.710655 29591 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.712355 25965 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.712561 29550 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:16.713371 29589 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.714282 26493 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:16.714236 25965 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.714789 29553 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:16.715261 26625 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.715674 29588 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.717051 29552 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:16.717563 26755 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:16.717944 29588 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.719889 26095 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:16.720402 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d8efe0d8a46e47a59900e07e6430cd37 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:16.720293 26625 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:16.719856 26096 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.722643 28145 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.723515 26625 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.723960 28275 raft_consensus.cc:1203] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:16.726279 25822 catalog_manager.cc:5484] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.726970 26755 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.728585 25962 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.720697 25818 catalog_manager.cc:5484] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:16.729557 26228 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.732458 26228 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:16.733019 25965 consensus_queue.cc:237] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:16.736356 26625 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:16.736924 26359 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:16.737056 26096 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:16.737375 29186 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:16.737506 29551 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:16.737704 26471 tablet_service.cc:1514] Processing DeleteTablet for tablet d8efe0d8a46e47a59900e07e6430cd37 with delete_type TABLET_DATA_TOMBSTONED (TS 9aaa16c4fc46478f90a3d97b010330c2 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:37788
I20240502 20:47:16.737811 29553 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:16.738355 26359 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:16.738973 26756 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:16.739423 29186 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:16.741245 26228 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:16.741398 26491 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:16.741881 29553 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:16.742157 29551 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:16.743091 26491 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:16.745643 29551 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:16.747869 25810 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet bf4199a73df149368fb8d04f4c9723ef with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:16.747908 26756 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:16.748379 29618 tablet_replica.cc:330] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2: stopping tablet replica
I20240502 20:47:16.748514 29618 raft_consensus.cc:2229] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:16.748736 29618 raft_consensus.cc:2258] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:16.748765 26096 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:16.749434 29618 ts_tablet_manager.cc:1875] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:16.750249 25814 catalog_manager.cc:5484] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:16.750583 26625 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:16.752332 26491 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:16.754355 26359 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:16.756315 26228 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:16.756557 29618 ts_tablet_manager.cc:1888] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:16.756646 29618 log.cc:1196] T d8efe0d8a46e47a59900e07e6430cd37 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/d8efe0d8a46e47a59900e07e6430cd37
I20240502 20:47:16.757189 25809 catalog_manager.cc:4830] TS 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495): tablet d8efe0d8a46e47a59900e07e6430cd37 (table rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]) successfully deleted
W20240502 20:47:16.763876 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf4199a73df149368fb8d04f4c9723ef. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:16.897680 29264 raft_consensus.cc:1050] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:16.898267 29264 consensus_queue.cc:237] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:16.900547 25962 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.900597 28275 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.900956 29659 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.901188 26096 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.901201 29160 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.901571 26359 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.901978 29479 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.902144 26228 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.903091 29479 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.903237 29659 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.903970 26756 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.904456 29657 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.905031 26625 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.906103 29657 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.906610 29160 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.908450 26359 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.908450 26228 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.908502 28275 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.910488 26095 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.911026 25814 catalog_manager.cc:5484] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:16.912298 26756 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.917140 29293 raft_consensus.cc:1050] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: attempting to promote NON_VOTER 706762b60f514a048c4935e359027441 to VOTER
I20240502 20:47:16.917678 29293 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:16.918016 26625 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.920003 26755 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.920095 25962 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.920558 29282 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.922219 26491 consensus_queue.cc:237] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:16.922420 28145 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.923152 29668 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.923938 26095 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.924168 28275 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.924355 29656 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.924603 26228 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.925274 29656 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.926131 26757 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.926837 29659 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.927039 29656 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.927162 26359 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.927882 26491 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.928290 25962 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.928642 26359 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.928923 29656 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.929133 29293 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.929204 29656 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.929690 26227 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.930033 25965 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.930950 26095 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:16.930893 29659 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.931284 29671 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.931648 29671 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.931771 26757 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.932861 29669 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.933477 29670 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:16.934413 28275 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.934413 26096 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.936661 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 51586991cf25422681e1f758f6b7c52d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:16.937314 25962 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.937652 25823 catalog_manager.cc:5484] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.938637 25965 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.939253 26229 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.939374 26359 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:16.941085 26604 tablet_service.cc:1514] Processing DeleteTablet for tablet 51586991cf25422681e1f758f6b7c52d with delete_type TABLET_DATA_TOMBSTONED (TS 4855f9c9a7f64986b4a0eb21e1ef6f0a not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:60510
I20240502 20:47:16.942643 29669 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.943222 25819 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.945277 29679 tablet_replica.cc:330] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: stopping tablet replica
I20240502 20:47:16.945936 29679 raft_consensus.cc:2229] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:16.946141 26095 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.946429 26359 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.947075 26491 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.948379 28145 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.951210 29679 raft_consensus.cc:2258] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:16.951370 26755 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.953004 29679 ts_tablet_manager.cc:1875] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:16.955130 26228 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.955701 29679 ts_tablet_manager.cc:1888] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:16.955854 29679 log.cc:1196] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/wals/51586991cf25422681e1f758f6b7c52d
I20240502 20:47:16.956470 25808 catalog_manager.cc:4830] TS 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815): tablet 51586991cf25422681e1f758f6b7c52d (table rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]) successfully deleted
I20240502 20:47:16.959247 26625 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:16.960916 26095 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.960925 26491 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.961088 28145 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.961124 25962 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.961460 29282 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.961654 29293 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.962010 29293 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.962329 29293 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.963348 26755 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.963826 29282 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.965085 26228 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:16.965564 29668 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:16.965888 29670 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.966542 26228 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.967481 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8659718d503141fa8a8024b700683858 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:16.967999 26095 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.968230 26491 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.969202 26755 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.969823 25962 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.970046 28145 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.972373 25819 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:16.975330 26341 tablet_service.cc:1514] Processing DeleteTablet for tablet 8659718d503141fa8a8024b700683858 with delete_type TABLET_DATA_TOMBSTONED (TS bbee1301f7b94c6ab339ecaccc4ce740 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56420
I20240502 20:47:16.976117 29680 tablet_replica.cc:330] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740: stopping tablet replica
I20240502 20:47:16.976336 29680 raft_consensus.cc:2229] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:16.976608 29680 raft_consensus.cc:2258] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:16.977833 29680 ts_tablet_manager.cc:1875] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:16.979633 29680 ts_tablet_manager.cc:1888] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:16.979712 29680 log.cc:1196] T 8659718d503141fa8a8024b700683858 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/8659718d503141fa8a8024b700683858
I20240502 20:47:16.980252 25809 catalog_manager.cc:4830] TS bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): tablet 8659718d503141fa8a8024b700683858 (table rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]) successfully deleted
I20240502 20:47:17.067186 29716 raft_consensus.cc:1050] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: attempting to promote NON_VOTER 706762b60f514a048c4935e359027441 to VOTER
I20240502 20:47:17.067747 29716 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:17.069543 26228 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.069744 26625 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.069916 28145 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.070008 26095 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.070497 25962 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.070453 29721 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.070494 26359 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.070732 29720 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.070940 29719 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.071056 29718 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.071211 29721 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.071761 26491 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.071856 29721 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.072777 29719 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.076061 29718 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.076473 26491 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.076659 26359 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.079237 26228 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.079310 28145 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.081296 25818 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.082387 25962 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.084048 26095 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.088105 26625 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.089437 26755 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:17.091050 26228 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.091266 26095 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.091459 28145 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.091485 25962 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.091691 29719 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.091912 29721 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.092170 26625 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.092226 29719 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.092748 29719 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.095559 29721 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.095813 26359 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.095929 28145 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.096592 29719 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.096872 29719 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.097437 25810 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:17.097946 26359 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.098268 26095 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.098872 26625 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.099313 25821 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.100503 26228 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.102993 25965 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.104341 26471 tablet_service.cc:1514] Processing DeleteTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with delete_type TABLET_DATA_TOMBSTONED (TS 9aaa16c4fc46478f90a3d97b010330c2 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:37788
I20240502 20:47:17.104573 29618 tablet_replica.cc:330] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2: stopping tablet replica
I20240502 20:47:17.104736 29618 raft_consensus.cc:2229] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:17.104920 29618 raft_consensus.cc:2258] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:17.114396 29618 ts_tablet_manager.cc:1875] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:17.117333 29618 ts_tablet_manager.cc:1888] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:17.117422 29618 log.cc:1196] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 9aaa16c4fc46478f90a3d97b010330c2: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/51a63a79b0ee42aba9fc7bf8e8c7428e
I20240502 20:47:17.118024 25809 catalog_manager.cc:4830] TS 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495): tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (table rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]) successfully deleted
I20240502 20:47:17.145628 29103 raft_consensus.cc:1050] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701: attempting to promote NON_VOTER 706762b60f514a048c4935e359027441 to VOTER
I20240502 20:47:17.146286 29103 consensus_queue.cc:237] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:17.148306 26625 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.148568 26359 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.148658 25962 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.148897 26491 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.148962 29731 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.149281 26228 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.149444 29732 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.149766 26755 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.149740 29731 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.150086 28698 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.150235 29733 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.150668 29731 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.152503 28145 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.152971 29731 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.153192 29733 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.154201 28145 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.154227 26491 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.154547 26755 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.157191 25821 catalog_manager.cc:5484] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.158361 26359 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.163763 26625 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.164134 26228 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.165505 25962 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.167817 26095 consensus_queue.cc:237] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:17.170118 28145 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.170246 25962 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.170384 26491 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.170501 29731 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.170789 26359 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.170780 29103 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.170843 26755 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.171164 26228 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.171670 29103 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.171865 29731 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.172173 29103 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.172307 29731 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.173854 29732 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.174328 25962 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.175541 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 441da21c8ff8492c88c752ebf1233857 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:17.176169 26228 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.176638 26491 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.176888 25819 catalog_manager.cc:5484] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:17.177971 26359 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.177979 26755 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.179858 28145 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.180505 26604 tablet_service.cc:1514] Processing DeleteTablet for tablet 441da21c8ff8492c88c752ebf1233857 with delete_type TABLET_DATA_TOMBSTONED (TS 4855f9c9a7f64986b4a0eb21e1ef6f0a not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:60510
I20240502 20:47:17.180797 29679 tablet_replica.cc:330] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: stopping tablet replica
I20240502 20:47:17.180956 29679 raft_consensus.cc:2229] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:17.181169 29679 raft_consensus.cc:2258] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:17.182049 29679 ts_tablet_manager.cc:1875] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:17.184738 29679 ts_tablet_manager.cc:1888] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:17.185933 29679 log.cc:1196] T 441da21c8ff8492c88c752ebf1233857 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-5/wal/wals/441da21c8ff8492c88c752ebf1233857
I20240502 20:47:17.186655 25808 catalog_manager.cc:4830] TS 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815): tablet 441da21c8ff8492c88c752ebf1233857 (table rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]) successfully deleted
I20240502 20:47:17.244220 29743 ts_tablet_manager.cc:902] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129)
I20240502 20:47:17.244742 29743 tablet_copy_client.cc:308] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:37129
I20240502 20:47:17.248807 25985 tablet_copy_service.cc:140] P 3c6dc91a7df244ab82c1161799ba2ff3: Received BeginTabletCopySession request for tablet bf4199a73df149368fb8d04f4c9723ef from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:43921)
I20240502 20:47:17.248939 25985 tablet_copy_service.cc:161] P 3c6dc91a7df244ab82c1161799ba2ff3: Beginning new tablet copy session on tablet bf4199a73df149368fb8d04f4c9723ef from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:43921: session id = 21a5e6dc2695447798b4a87e7c6108db-bf4199a73df149368fb8d04f4c9723ef
I20240502 20:47:17.249944 25985 tablet_copy_source_session.cc:205] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:17.250809 29743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4199a73df149368fb8d04f4c9723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:17.253108 29743 tablet_copy_client.cc:783] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:17.253280 29743 tablet_copy_client.cc:647] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:17.255707 29743 tablet_copy_client.cc:523] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:17.256943 29743 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:17.263561 26491 consensus_queue.cc:237] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } }
I20240502 20:47:17.265553 26095 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:17.265650 26755 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:17.265957 29479 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:17.266070 25962 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:17.266607 26625 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:17.266788 29659 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:17.267414 29479 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:17.267966 29479 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:17.268513 26359 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:17.268726 26228 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:17.268913 29659 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:17.270007 29659 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:17.271832 29658 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:17.274519 26625 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:17.274886 26755 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:17.276237 26095 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:17.277148 25819 catalog_manager.cc:5484] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } }
I20240502 20:47:17.280022 26228 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:17.280297 26359 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:17.280967 29743 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:17.281247 29743 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:17.281725 29743 ts_tablet_manager.cc:1367] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.025s user 0.022s sys 0.003s
I20240502 20:47:17.282281 29743 raft_consensus.cc:348] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:17.282582 29743 raft_consensus.cc:729] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:17.282791 29743 consensus_queue.cc:260] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:17.283201 29743 ts_tablet_manager.cc:1398] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:17.283327 25962 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } }
I20240502 20:47:17.285033 25985 tablet_copy_service.cc:342] P 3c6dc91a7df244ab82c1161799ba2ff3: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-bf4199a73df149368fb8d04f4c9723ef received from {username='slave'} at 127.9.82.138:43921
I20240502 20:47:17.285113 25985 tablet_copy_service.cc:433] P 3c6dc91a7df244ab82c1161799ba2ff3: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-bf4199a73df149368fb8d04f4c9723ef on tablet bf4199a73df149368fb8d04f4c9723ef with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:17.287317 29659 raft_consensus.cc:1050] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: attempting to promote NON_VOTER 706762b60f514a048c4935e359027441 to VOTER
I20240502 20:47:17.287922 29659 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:17.289001 26491 consensus_queue.cc:237] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:17.290194 28145 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 LEARNER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.290558 26095 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20240502 20:47:17.290843 26426 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe3671f95cd0488cbdf684011ad3d1e3. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:17.291193 26361 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:17.291198 26625 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.291183 29264 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.291502 26624 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:17.291630 29264 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:17.291677 26229 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:17.291915 25965 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:17.292220 26228 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.292436 26095 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:17.292743 29657 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:17.292907 29659 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:17.293069 29264 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.293220 29656 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.294173 26359 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.294238 29656 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:17.294565 29656 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.294926 29656 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:17.296363 26757 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:17.297720 29657 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.297920 29160 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:17.298228 29160 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:17.299208 26624 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:17.300112 25809 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet fe3671f95cd0488cbdf684011ad3d1e3 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 20:47:17.300217 25965 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:17.300688 26229 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:17.303297 26359 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:17.304046 25814 catalog_manager.cc:5484] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:17.306593 26095 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:17.307070 29479 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.308169 28145 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.310706 26229 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.311793 25819 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.312005 26359 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.313097 26624 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.316015 26095 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.321959 26755 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.322367 29160 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.322535 25962 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.322997 29160 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.324347 25962 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.327042 26755 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 706762b60f514a048c4935e359027441 (127.9.82.136) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.332450 26757 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:17.345081 29150 raft_consensus.cc:1050] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:17.345724 29150 consensus_queue.cc:237] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:17.348632 26624 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.348650 26095 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.349066 25962 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.349120 29588 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.349283 28275 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.349434 26757 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.349753 29788 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.350272 29791 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.350384 26491 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.350384 26229 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:17.350441 29793 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.350787 29793 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.350916 29150 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.351431 29588 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:17.354671 29150 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.356576 28275 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.358204 25962 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.358419 26229 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.359437 25817 catalog_manager.cc:5484] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d reported cstate change: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.361516 26757 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.362380 26491 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.362882 26624 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.366564 26095 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { replace: true } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.368577 26359 consensus_queue.cc:237] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:17.370823 26757 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.371100 26229 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.371235 26625 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.371464 29588 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.371639 29793 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.372269 25962 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.372740 29150 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.372929 28275 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.372988 29788 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.373543 29788 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.373678 26095 raft_consensus.cc:1261] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.374099 29788 consensus_queue.cc:1035] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.375577 29150 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.376044 26229 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.377413 26095 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.378813 25821 catalog_manager.cc:5484] T d19c2fce372b4bbb936013051cc32978 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.380010 26625 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.380771 26757 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.382616 26471 tablet_service.cc:1514] Processing DeleteTablet for tablet d19c2fce372b4bbb936013051cc32978 with delete_type TABLET_DATA_TOMBSTONED (TS 9aaa16c4fc46478f90a3d97b010330c2 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:37788
I20240502 20:47:17.383028 29618 tablet_replica.cc:330] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2: stopping tablet replica
I20240502 20:47:17.383172 29618 raft_consensus.cc:2229] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:17.383353 29618 raft_consensus.cc:2258] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:17.384215 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d19c2fce372b4bbb936013051cc32978 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:17.384840 29618 ts_tablet_manager.cc:1875] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:17.387162 29618 ts_tablet_manager.cc:1888] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:17.387259 29618 log.cc:1196] T d19c2fce372b4bbb936013051cc32978 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-4/wal/wals/d19c2fce372b4bbb936013051cc32978
I20240502 20:47:17.387876 25809 catalog_manager.cc:4830] TS 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495): tablet d19c2fce372b4bbb936013051cc32978 (table rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]) successfully deleted
I20240502 20:47:17.389614 28275 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.389899 25962 raft_consensus.cc:2932] T d19c2fce372b4bbb936013051cc32978 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:17.671676 28407 raft_consensus.cc:1203] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:17.744931 26491 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } }
I20240502 20:47:17.747045 28145 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.747323 26757 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.747424 26625 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.747546 25962 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.747836 29659 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.748070 29160 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.748220 29657 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.748574 29659 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.748725 26095 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.749218 29160 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.751624 29657 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.752022 26229 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:17.752382 25962 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.752650 29659 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:17.754251 26229 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.755892 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet adb68aca646d42b2a869eaab1e3e805b with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:17.755839 26625 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.756398 26095 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.757544 25821 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.758734 26757 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.762974 28145 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } }
I20240502 20:47:17.763952 26341 tablet_service.cc:1514] Processing DeleteTablet for tablet adb68aca646d42b2a869eaab1e3e805b with delete_type TABLET_DATA_TOMBSTONED (TS bbee1301f7b94c6ab339ecaccc4ce740 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56420
I20240502 20:47:17.764355 29835 tablet_replica.cc:330] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740: stopping tablet replica
I20240502 20:47:17.765048 29835 raft_consensus.cc:2229] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:17.765276 29835 raft_consensus.cc:2258] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:17.766072 29835 ts_tablet_manager.cc:1875] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:17.768635 29835 ts_tablet_manager.cc:1888] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:17.768734 29835 log.cc:1196] T adb68aca646d42b2a869eaab1e3e805b P bbee1301f7b94c6ab339ecaccc4ce740: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/adb68aca646d42b2a869eaab1e3e805b
I20240502 20:47:17.769351 25809 catalog_manager.cc:4830] TS bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): tablet adb68aca646d42b2a869eaab1e3e805b (table rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]) successfully deleted
I20240502 20:47:17.872584 29851 ts_tablet_manager.cc:902] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:17.873276 29851 tablet_copy_client.cc:308] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:37495
I20240502 20:47:17.873769 26513 tablet_copy_service.cc:140] P 9aaa16c4fc46478f90a3d97b010330c2: Received BeginTabletCopySession request for tablet fe3671f95cd0488cbdf684011ad3d1e3 from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:37881)
I20240502 20:47:17.873883 26513 tablet_copy_service.cc:161] P 9aaa16c4fc46478f90a3d97b010330c2: Beginning new tablet copy session on tablet fe3671f95cd0488cbdf684011ad3d1e3 from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:37881: session id = cc2b212930b84db1bb56f6952197955d-fe3671f95cd0488cbdf684011ad3d1e3
I20240502 20:47:17.874958 26513 tablet_copy_source_session.cc:205] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:17.875854 29851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3671f95cd0488cbdf684011ad3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:17.877737 29851 tablet_copy_client.cc:783] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:17.877920 29851 tablet_copy_client.cc:647] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:17.878993 29851 tablet_copy_client.cc:523] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:17.880049 29851 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:17.909574 29851 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:17.909919 29851 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:17.910152 29851 ts_tablet_manager.cc:1367] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.030s user 0.021s sys 0.001s
I20240502 20:47:17.910631 29851 raft_consensus.cc:348] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:17.910775 29851 raft_consensus.cc:729] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:17.910913 29851 consensus_queue.cc:260] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:17.911278 29851 ts_tablet_manager.cc:1398] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:47:17.911911 26513 tablet_copy_service.cc:342] P 9aaa16c4fc46478f90a3d97b010330c2: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-fe3671f95cd0488cbdf684011ad3d1e3 received from {username='slave'} at 127.9.82.137:37881
I20240502 20:47:17.911999 26513 tablet_copy_service.cc:433] P 9aaa16c4fc46478f90a3d97b010330c2: ending tablet copy session cc2b212930b84db1bb56f6952197955d-fe3671f95cd0488cbdf684011ad3d1e3 on tablet fe3671f95cd0488cbdf684011ad3d1e3 with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:18.048290 26095 consensus_queue.cc:237] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } }
I20240502 20:47:18.050230 26228 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:18.050240 26625 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:18.050385 26359 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:18.050624 26491 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:18.050798 29733 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:18.051236 26757 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:18.051241 25962 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 20:47:18.051407 29733 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:18.051565 29732 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:18.052147 29732 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:18.052289 29868 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:18.052439 29733 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 20:47:18.054597 29868 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:18.056555 25962 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:18.057138 26625 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:18.057328 26228 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:18.059942 25822 catalog_manager.cc:5484] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:18.060719 26757 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:18.062227 26491 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:18.062937 26359 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } }
I20240502 20:47:18.066561 26095 consensus_queue.cc:237] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:18.068554 26359 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:18.068655 26228 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:18.069537 26491 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:18.069537 25965 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:18.069837 26757 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:18.071470 29868 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:18.072305 29868 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:18.072724 29732 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:18.073202 29732 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:18.073513 29733 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:18.076628 26359 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:18.077636 26625 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 20:47:18.078166 29733 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 20:47:18.078595 26757 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:18.079239 26491 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:18.080220 26625 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:18.081652 25822 catalog_manager.cc:5484] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:18.087471 29881 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:18.089771 25808 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20240502 20:47:18.090780 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c4c0137c6aa4820b0f0a5cf001c56d1. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:18.090728 26228 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:18.091704 25962 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:18.152774 29834 raft_consensus.cc:1050] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:18.153445 29834 consensus_queue.cc:237] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:18.155160 28407 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.155498 26228 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.155540 29550 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.155845 26359 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.155848 26491 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.156258 29550 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.156348 26625 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.156524 26757 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.156584 29550 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.156895 26096 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.156927 29550 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.157166 29896 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.158233 29899 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.159205 29899 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.160993 29550 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.161136 28407 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.161751 26096 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.163539 26491 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.163946 26757 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.164340 25817 catalog_manager.cc:5484] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db reported cstate change: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.164352 26625 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.163513 26228 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.168606 26359 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.172641 25962 consensus_queue.cc:237] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:18.174705 28407 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:18.174764 26096 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:18.174932 26491 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:18.175220 29897 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:18.175321 26228 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:18.175755 29897 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:18.175822 26757 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:18.175916 29899 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:18.176188 29896 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:18.176692 29896 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:18.176578 26625 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:18.178478 29896 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:18.179075 29834 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.179695 26096 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.180408 26625 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.181048 25810 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet bf4199a73df149368fb8d04f4c9723ef with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:18.182549 26491 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.182667 26757 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.182967 25818 catalog_manager.cc:5484] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:18.185089 28407 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.179695 26228 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:18.189993 26341 tablet_service.cc:1514] Processing DeleteTablet for tablet bf4199a73df149368fb8d04f4c9723ef with delete_type TABLET_DATA_TOMBSTONED (TS bbee1301f7b94c6ab339ecaccc4ce740 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56420
I20240502 20:47:18.190438 29835 tablet_replica.cc:330] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: stopping tablet replica
I20240502 20:47:18.190591 29835 raft_consensus.cc:2229] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:18.190809 29835 raft_consensus.cc:2258] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:18.191551 29835 ts_tablet_manager.cc:1875] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:18.193681 29835 ts_tablet_manager.cc:1888] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:18.193769 29835 log.cc:1196] T bf4199a73df149368fb8d04f4c9723ef P bbee1301f7b94c6ab339ecaccc4ce740: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/bf4199a73df149368fb8d04f4c9723ef
I20240502 20:47:18.194231 25809 catalog_manager.cc:4830] TS bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): tablet bf4199a73df149368fb8d04f4c9723ef (table rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]) successfully deleted
I20240502 20:47:18.372573 28275 raft_consensus.cc:1203] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:18.481406 29923 ts_tablet_manager.cc:902] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:18.481997 29923 tablet_copy_client.cc:308] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:34445
I20240502 20:47:18.486044 26116 tablet_copy_service.cc:140] P 73a41df730ef429d84fe648df03a2701: Received BeginTabletCopySession request for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:47281)
I20240502 20:47:18.486157 26116 tablet_copy_service.cc:161] P 73a41df730ef429d84fe648df03a2701: Beginning new tablet copy session on tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:47281: session id = 21a5e6dc2695447798b4a87e7c6108db-1c4c0137c6aa4820b0f0a5cf001c56d1
I20240502 20:47:18.487039 26116 tablet_copy_source_session.cc:205] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:18.487937 29923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:18.489796 29923 tablet_copy_client.cc:783] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:18.489957 29923 tablet_copy_client.cc:647] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:18.491379 29923 tablet_copy_client.cc:523] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:18.492455 29923 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:18.511248 29923 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:18.511554 29923 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:18.511780 29923 ts_tablet_manager.cc:1367] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.003s
I20240502 20:47:18.512213 29923 raft_consensus.cc:348] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:18.512341 29923 raft_consensus.cc:729] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:18.512450 29923 consensus_queue.cc:260] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:18.512729 29923 ts_tablet_manager.cc:1398] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:18.513422 26116 tablet_copy_service.cc:342] P 73a41df730ef429d84fe648df03a2701: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-1c4c0137c6aa4820b0f0a5cf001c56d1 received from {username='slave'} at 127.9.82.138:47281
I20240502 20:47:18.513514 26116 tablet_copy_service.cc:433] P 73a41df730ef429d84fe648df03a2701: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-1c4c0137c6aa4820b0f0a5cf001c56d1 on tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:18.984201 28407 raft_consensus.cc:1203] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 20:47:18.985222 29656 raft_consensus.cc:1050] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:18.985843 29656 consensus_queue.cc:237] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:18.987615 28275 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.988005 25962 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.988005 26757 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.988193 26096 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.988224 26228 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.988382 26625 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.988741 26359 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:18.988775 29966 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.989133 29965 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.989260 29656 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.989410 29907 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.989598 29967 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.989709 29969 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.990149 29968 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:18.992944 29967 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:18.993445 25965 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:18.994284 26228 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:18.995260 26096 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:18.995694 28275 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:18.995851 26757 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:18.997422 25822 catalog_manager.cc:5484] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:18.998940 26359 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:19.000464 26625 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:19.007872 26491 consensus_queue.cc:237] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:19.009585 26757 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.009752 26096 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.009940 28275 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.009968 26625 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.010342 25965 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.010378 29967 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.010710 29966 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.010893 29969 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.011062 29967 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.011322 29907 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.012898 26228 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.013253 29969 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.013195 29967 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:19.013975 26757 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:19.014060 26096 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:19.014366 26228 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:19.016587 28275 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:19.017190 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet fe3671f95cd0488cbdf684011ad3d1e3 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:19.017846 25814 catalog_manager.cc:5484] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:19.018797 25965 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:19.020274 26625 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:19.024788 26341 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3671f95cd0488cbdf684011ad3d1e3 with delete_type TABLET_DATA_TOMBSTONED (TS bbee1301f7b94c6ab339ecaccc4ce740 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56420
I20240502 20:47:19.025156 29981 tablet_replica.cc:330] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: stopping tablet replica
I20240502 20:47:19.025292 29981 raft_consensus.cc:2229] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:19.025493 29981 raft_consensus.cc:2258] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:19.026399 29981 ts_tablet_manager.cc:1875] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:19.028424 29981 ts_tablet_manager.cc:1888] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:19.028499 29981 log.cc:1196] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/fe3671f95cd0488cbdf684011ad3d1e3
I20240502 20:47:19.029014 25809 catalog_manager.cc:4830] TS bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): tablet fe3671f95cd0488cbdf684011ad3d1e3 (table rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]) successfully deleted
I20240502 20:47:19.428929 29869 raft_consensus.cc:1050] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:19.429430 29869 consensus_queue.cc:237] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:19.431249 26228 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:19.431627 26755 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:19.431782 26493 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:19.431792 26625 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:19.431867 28407 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:19.432148 30000 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:19.432204 26359 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:19.432348 29999 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:19.432713 30001 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:19.433156 29963 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:19.433348 29999 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:19.433842 25965 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 20:47:19.434010 30000 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:19.434291 30001 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 20:47:19.437110 30002 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.437479 28407 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.438323 26493 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.438609 26359 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.440423 26755 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.440423 26625 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.440443 25965 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.442014 25821 catalog_manager.cc:5484] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db reported cstate change: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.445698 26228 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.451119 26095 consensus_queue.cc:237] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:19.452745 26755 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.452745 26228 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.452838 28407 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.452819 26625 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.453176 29881 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.453292 26493 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.453713 29881 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.453869 29869 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.453999 30001 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.454195 30000 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.455814 25965 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 20:47:19.456753 29999 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 20:47:19.457020 29881 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.457916 26755 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.458930 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:19.459183 26229 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.459806 25965 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.459894 26491 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.461763 25819 catalog_manager.cc:5484] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:19.463109 26625 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.464701 28407 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:19.465762 26341 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 with delete_type TABLET_DATA_TOMBSTONED (TS bbee1301f7b94c6ab339ecaccc4ce740 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:56420
I20240502 20:47:19.466143 29981 tablet_replica.cc:330] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: stopping tablet replica
I20240502 20:47:19.466297 29981 raft_consensus.cc:2229] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:19.466514 29981 raft_consensus.cc:2258] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:19.467696 29981 ts_tablet_manager.cc:1875] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:19.469918 29981 ts_tablet_manager.cc:1888] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 20:47:19.469992 29981 log.cc:1196] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-3/wal/wals/1c4c0137c6aa4820b0f0a5cf001c56d1
I20240502 20:47:19.470561 25809 catalog_manager.cc:4830] TS bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 (table rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]) successfully deleted
I20240502 20:47:19.872531 26209 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:19.875859 26604 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:19.881765 25945 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:19.885807 26471 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:19.888825 28387 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:19.889530 26077 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:47:19.895001 28256 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:19.913000 26736 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:19.915854 28125 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:19.953146 26341 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:47:20.054035 28387 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:20.058013 26209 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:20.061815 26604 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:20.062228 26077 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:47:20.067545 26471 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:20.070751 25945 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:20.075021 28125 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:20.077031 26736 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:20.077468 28256 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:20.088721 26341 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:47:20.172863 26493 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.175256 26229 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.175554 28145 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.175693 25965 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.175789 30116 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.176147 30115 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.177068 26625 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.177524 30116 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.177587 26095 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.178081 30116 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.178514 30115 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.178656 26755 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.179037 30115 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.181228 30116 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
W20240502 20:47:20.181651 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adb68aca646d42b2a869eaab1e3e805b. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.182219 25965 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.182734 26755 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.184819 25821 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:20.185824 26625 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.185911 26095 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.186142 28145 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.189440 26229 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.199585 26755 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.201639 26229 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.201879 26359 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.201977 26095 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.202076 29729 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.202275 30137 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.203112 26625 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.203333 28145 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.203538 29729 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.203683 25965 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.203835 30138 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.205399 30135 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.205643 30134 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.207249 26095 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.207527 30138 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.208297 28145 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.210266 25814 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.211328 26229 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.211479 26361 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
W20240502 20:47:20.211747 26690 consensus_peers.cc:485] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51a63a79b0ee42aba9fc7bf8e8c7428e. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.212738 25965 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.213032 26625 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.223668 26625 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.225389 28145 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.225389 26755 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.225908 26095 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.225986 26493 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.226219 26229 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.226398 30155 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 20:47:20.226936 26559 consensus_peers.cc:485] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8659718d503141fa8a8024b700683858. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.227021 30154 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.227056 25965 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.227178 30010 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.227465 30010 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.227689 29670 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.227872 30010 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.229758 30153 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.230159 25965 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.232357 26493 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.232729 28145 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.233287 25823 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.235745 26755 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.238723 26095 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.242372 26229 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.247915 26361 consensus_queue.cc:237] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
W20240502 20:47:20.249773 26294 consensus_peers.cc:485] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8efe0d8a46e47a59900e07e6430cd37. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.249788 26229 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.250000 26095 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.250201 25965 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.250200 26755 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.250267 30017 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.250425 29858 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.250820 28145 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.250829 30017 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.251137 30017 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.251765 29858 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.252457 26625 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.253402 30169 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.254098 30170 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.255105 25965 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.255772 28145 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.256577 26095 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.256829 26625 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.258065 26229 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.258944 25818 catalog_manager.cc:5484] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:20.264468 26755 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.271703 26624 consensus_queue.cc:237] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.273681 26493 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.273749 26229 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.273819 26361 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.274122 28145 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.274271 26095 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.274242 30010 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.274580 25965 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.274614 30010 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 20:47:20.274739 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f81a35dbe00342f89c4a42a3cfbbeacc. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.274924 30154 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.275087 30155 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.275372 30010 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.275671 30010 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.277843 30184 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.278267 25965 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.279009 28145 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.280530 26095 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.280803 26229 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.280953 26361 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.283152 25821 catalog_manager.cc:5484] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.283985 26493 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.294601 26229 consensus_queue.cc:237] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.296705 26493 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.296720 28407 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.296814 26095 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.297168 30197 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.297245 26624 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.297510 30199 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.297700 29952 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.297844 30105 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.298082 26755 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.298282 25965 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 20:47:20.297700 26162 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00bf11a3e1c24449bba6a09d4ab280b0. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.298630 30199 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.299597 30197 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.301283 30105 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.303571 26493 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.303658 26624 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.303768 28407 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.306442 25818 catalog_manager.cc:5484] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.307855 26095 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.311389 26755 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.311523 25965 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.330207 26095 consensus_queue.cc:237] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.332237 26493 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.332495 26361 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.332608 26755 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.332640 28145 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.332790 25965 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.332865 26229 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.333230 30214 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.333527 30000 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.334283 30002 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.334475 30215 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 20:47:20.334623 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec36083ee0ce441c9b2337a48d41a5fc. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.334704 30216 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.334832 30217 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.338608 30215 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.339006 25965 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.340111 26361 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.343010 25823 catalog_manager.cc:5484] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.345240 26493 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.343626 26229 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.356834 28145 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.358667 26757 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.378409 26755 consensus_queue.cc:237] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.381093 26229 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.381631 26361 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.381897 25965 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.381953 28145 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.382148 26095 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.382256 26493 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.382730 30134 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.383011 30137 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.383141 30134 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.383278 29729 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.383415 30136 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 20:47:20.383544 26690 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50134092a82f42b08ffacf2eff58b0f9. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.383823 30138 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.386960 30136 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.387414 26493 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.388927 25965 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.389798 26229 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.390949 28145 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.391362 26361 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.391456 25818 catalog_manager.cc:5484] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.397202 26095 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.410107 26229 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.412372 26755 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.412425 26493 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.412488 26624 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.412835 25965 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.412834 30105 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.413005 30197 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.413436 30242 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.413893 28275 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 20:47:20.413970 26163 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 679352ffb9884583a0f1ee092d4badb1. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.414214 30199 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.414269 26095 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.414619 30199 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.414747 30105 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.417762 26755 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.417686 30205 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.418324 28275 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.420257 26493 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.420929 25965 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.421813 25823 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.423319 26624 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.426084 26095 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:20.440940 26624 consensus_queue.cc:237] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.443518 26755 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.444002 26361 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.444229 28407 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.444545 29670 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.444733 30153 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.445005 26229 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.445175 29670 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.446790 25965 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.446841 30153 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.447381 30153 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 20:47:20.449059 26558 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23d260f1c3be4dd1b18fc82af355c137. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:20.449755 26095 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:20.449611 30153 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.450170 30152 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:20.451627 26361 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.451694 26095 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.451946 26755 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.453595 26229 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.454485 28407 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.456329 25821 catalog_manager.cc:5484] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.463016 25965 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:20.623273 30313 ts_tablet_manager.cc:902] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:20.623939 30313 tablet_copy_client.cc:308] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:37495
I20240502 20:47:20.626243 30319 ts_tablet_manager.cc:902] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125)
I20240502 20:47:20.626847 30319 tablet_copy_client.cc:308] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:43125
I20240502 20:47:20.627436 26381 tablet_copy_service.cc:140] P bbee1301f7b94c6ab339ecaccc4ce740: Received BeginTabletCopySession request for tablet d8efe0d8a46e47a59900e07e6430cd37 from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:56675)
I20240502 20:47:20.627543 26381 tablet_copy_service.cc:161] P bbee1301f7b94c6ab339ecaccc4ce740: Beginning new tablet copy session on tablet d8efe0d8a46e47a59900e07e6430cd37 from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:56675: session id = cc2b212930b84db1bb56f6952197955d-d8efe0d8a46e47a59900e07e6430cd37
I20240502 20:47:20.628650 26381 tablet_copy_source_session.cc:205] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:20.628911 26513 tablet_copy_service.cc:140] P 9aaa16c4fc46478f90a3d97b010330c2: Received BeginTabletCopySession request for tablet adb68aca646d42b2a869eaab1e3e805b from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:59211)
I20240502 20:47:20.629006 26513 tablet_copy_service.cc:161] P 9aaa16c4fc46478f90a3d97b010330c2: Beginning new tablet copy session on tablet adb68aca646d42b2a869eaab1e3e805b from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:59211: session id = 21a5e6dc2695447798b4a87e7c6108db-adb68aca646d42b2a869eaab1e3e805b
I20240502 20:47:20.629622 30319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8efe0d8a46e47a59900e07e6430cd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:20.629843 26513 tablet_copy_source_session.cc:205] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:20.630815 30313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:20.631884 30319 tablet_copy_client.cc:783] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:20.632048 30319 tablet_copy_client.cc:647] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:20.632901 30313 tablet_copy_client.cc:783] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:20.633051 30313 tablet_copy_client.cc:647] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:20.634531 30313 tablet_copy_client.cc:523] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:20.634799 30319 tablet_copy_client.cc:523] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:20.635776 30313 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:20.636147 30319 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:20.661863 30319 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:20.662240 30319 tablet_bootstrap.cc:492] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:20.662436 30319 ts_tablet_manager.cc:1367] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.026s user 0.024s sys 0.000s
I20240502 20:47:20.663005 30319 raft_consensus.cc:348] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.663172 30319 raft_consensus.cc:729] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:20.663272 30319 consensus_queue.cc:260] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.663621 30319 ts_tablet_manager.cc:1398] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:20.664196 26381 tablet_copy_service.cc:342] P bbee1301f7b94c6ab339ecaccc4ce740: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-d8efe0d8a46e47a59900e07e6430cd37 received from {username='slave'} at 127.9.82.137:56675
I20240502 20:47:20.664281 26381 tablet_copy_service.cc:433] P bbee1301f7b94c6ab339ecaccc4ce740: ending tablet copy session cc2b212930b84db1bb56f6952197955d-d8efe0d8a46e47a59900e07e6430cd37 on tablet d8efe0d8a46e47a59900e07e6430cd37 with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:20.667850 30313 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:20.668089 30313 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:20.668269 30313 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.033s user 0.024s sys 0.005s
I20240502 20:47:20.668678 30313 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.668792 30313 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:20.668866 30313 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.669158 30313 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:20.669790 26513 tablet_copy_service.cc:342] P 9aaa16c4fc46478f90a3d97b010330c2: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-adb68aca646d42b2a869eaab1e3e805b received from {username='slave'} at 127.9.82.138:59211
I20240502 20:47:20.669890 26513 tablet_copy_service.cc:433] P 9aaa16c4fc46478f90a3d97b010330c2: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-adb68aca646d42b2a869eaab1e3e805b on tablet adb68aca646d42b2a869eaab1e3e805b with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:20.689393 30313 ts_tablet_manager.cc:902] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:20.689862 30313 tablet_copy_client.cc:308] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.134:39815
I20240502 20:47:20.691350 26645 tablet_copy_service.cc:140] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Received BeginTabletCopySession request for tablet 8659718d503141fa8a8024b700683858 from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:50759)
I20240502 20:47:20.691475 26645 tablet_copy_service.cc:161] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Beginning new tablet copy session on tablet 8659718d503141fa8a8024b700683858 from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:50759: session id = 21a5e6dc2695447798b4a87e7c6108db-8659718d503141fa8a8024b700683858
I20240502 20:47:20.692306 26645 tablet_copy_source_session.cc:205] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:20.693158 30313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:20.695026 30313 tablet_copy_client.cc:783] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:20.695184 30313 tablet_copy_client.cc:647] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:20.696439 30313 tablet_copy_client.cc:523] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:20.697623 30313 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:20.719655 30313 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:20.720016 30313 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:20.720263 30313 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.023s user 0.023s sys 0.000s
I20240502 20:47:20.720697 30313 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.720865 30313 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:20.720991 30313 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.721335 30313 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:20.721835 26645 tablet_copy_service.cc:342] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-8659718d503141fa8a8024b700683858 received from {username='slave'} at 127.9.82.138:50759
I20240502 20:47:20.721940 26645 tablet_copy_service.cc:433] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-8659718d503141fa8a8024b700683858 on tablet 8659718d503141fa8a8024b700683858 with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:20.740931 30313 ts_tablet_manager.cc:902] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:20.741470 30313 tablet_copy_client.cc:308] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:34445
I20240502 20:47:20.741982 26116 tablet_copy_service.cc:140] P 73a41df730ef429d84fe648df03a2701: Received BeginTabletCopySession request for tablet ec36083ee0ce441c9b2337a48d41a5fc from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:47281)
I20240502 20:47:20.742122 26116 tablet_copy_service.cc:161] P 73a41df730ef429d84fe648df03a2701: Beginning new tablet copy session on tablet ec36083ee0ce441c9b2337a48d41a5fc from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:47281: session id = 21a5e6dc2695447798b4a87e7c6108db-ec36083ee0ce441c9b2337a48d41a5fc
I20240502 20:47:20.743191 26116 tablet_copy_source_session.cc:205] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:20.744326 30350 ts_tablet_manager.cc:902] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:20.744331 30313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec36083ee0ce441c9b2337a48d41a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:20.745007 30350 tablet_copy_client.cc:308] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.134:39815
I20240502 20:47:20.745755 26645 tablet_copy_service.cc:140] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Received BeginTabletCopySession request for tablet f81a35dbe00342f89c4a42a3cfbbeacc from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:50759)
I20240502 20:47:20.745875 26645 tablet_copy_service.cc:161] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Beginning new tablet copy session on tablet f81a35dbe00342f89c4a42a3cfbbeacc from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:50759: session id = 21a5e6dc2695447798b4a87e7c6108db-f81a35dbe00342f89c4a42a3cfbbeacc
I20240502 20:47:20.746814 26645 tablet_copy_source_session.cc:205] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:20.746894 30313 tablet_copy_client.cc:783] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:20.747036 30313 tablet_copy_client.cc:647] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:20.747658 30350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81a35dbe00342f89c4a42a3cfbbeacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:20.748283 30313 tablet_copy_client.cc:523] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:20.749369 30313 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:20.749497 30350 tablet_copy_client.cc:783] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:20.749639 30350 tablet_copy_client.cc:647] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:20.751058 30350 tablet_copy_client.cc:523] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:20.752234 30350 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:20.777060 30319 ts_tablet_manager.cc:902] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:20.777539 30313 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:20.777626 30319 tablet_copy_client.cc:308] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.135:39673
I20240502 20:47:20.777824 30313 tablet_bootstrap.cc:492] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:20.778031 30313 ts_tablet_manager.cc:1367] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.029s user 0.023s sys 0.004s
I20240502 20:47:20.778519 30313 raft_consensus.cc:348] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.778993 30313 raft_consensus.cc:729] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:20.779155 30313 consensus_queue.cc:260] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.779568 30313 ts_tablet_manager.cc:1398] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:20.780135 26116 tablet_copy_service.cc:342] P 73a41df730ef429d84fe648df03a2701: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-ec36083ee0ce441c9b2337a48d41a5fc received from {username='slave'} at 127.9.82.138:47281
I20240502 20:47:20.780213 26116 tablet_copy_service.cc:433] P 73a41df730ef429d84fe648df03a2701: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-ec36083ee0ce441c9b2337a48d41a5fc on tablet ec36083ee0ce441c9b2337a48d41a5fc with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:20.781500 30382 ts_tablet_manager.cc:902] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:20.782578 30382 tablet_copy_client.cc:308] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.135:39673
I20240502 20:47:20.787798 26776 tablet_copy_service.cc:140] P b4908484400a4ce2aea341e9e1bdced3: Received BeginTabletCopySession request for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:43117)
I20240502 20:47:20.787813 26777 tablet_copy_service.cc:140] P b4908484400a4ce2aea341e9e1bdced3: Received BeginTabletCopySession request for tablet 50134092a82f42b08ffacf2eff58b0f9 from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:43117)
I20240502 20:47:20.787925 26776 tablet_copy_service.cc:161] P b4908484400a4ce2aea341e9e1bdced3: Beginning new tablet copy session on tablet 51a63a79b0ee42aba9fc7bf8e8c7428e from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:43117: session id = cc2b212930b84db1bb56f6952197955d-51a63a79b0ee42aba9fc7bf8e8c7428e
I20240502 20:47:20.788059 26777 tablet_copy_service.cc:161] P b4908484400a4ce2aea341e9e1bdced3: Beginning new tablet copy session on tablet 50134092a82f42b08ffacf2eff58b0f9 from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:43117: session id = cc2b212930b84db1bb56f6952197955d-50134092a82f42b08ffacf2eff58b0f9
I20240502 20:47:20.788904 26776 tablet_copy_source_session.cc:205] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:20.788903 26777 tablet_copy_source_session.cc:205] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:20.790040 30319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:20.790185 30382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:20.791821 30319 tablet_copy_client.cc:783] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:20.791988 30319 tablet_copy_client.cc:647] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:20.792791 30382 tablet_copy_client.cc:783] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:20.793068 30382 tablet_copy_client.cc:647] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:20.794276 30382 tablet_copy_client.cc:523] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:20.794437 30319 tablet_copy_client.cc:523] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:20.795423 30382 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:20.795821 30319 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:20.801874 30350 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:20.802142 30350 tablet_bootstrap.cc:492] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:20.802316 30350 ts_tablet_manager.cc:1367] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.050s user 0.025s sys 0.002s
I20240502 20:47:20.802712 30350 raft_consensus.cc:348] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.802834 30350 raft_consensus.cc:729] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:20.802949 30350 consensus_queue.cc:260] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:20.803786 30350 ts_tablet_manager.cc:1398] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:47:20.806180 26645 tablet_copy_service.cc:342] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-f81a35dbe00342f89c4a42a3cfbbeacc received from {username='slave'} at 127.9.82.138:50759
I20240502 20:47:20.806277 26645 tablet_copy_service.cc:433] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-f81a35dbe00342f89c4a42a3cfbbeacc on tablet f81a35dbe00342f89c4a42a3cfbbeacc with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:20.821821 30319 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:20.822077 30319 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:20.822209 30319 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.026s user 0.021s sys 0.000s
I20240502 20:47:20.822602 30319 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.822731 30319 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:20.822808 30319 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.823275 30319 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:47:20.823851 26777 tablet_copy_service.cc:342] P b4908484400a4ce2aea341e9e1bdced3: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-50134092a82f42b08ffacf2eff58b0f9 received from {username='slave'} at 127.9.82.137:43117
I20240502 20:47:20.823935 26777 tablet_copy_service.cc:433] P b4908484400a4ce2aea341e9e1bdced3: ending tablet copy session cc2b212930b84db1bb56f6952197955d-50134092a82f42b08ffacf2eff58b0f9 on tablet 50134092a82f42b08ffacf2eff58b0f9 with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:20.829219 30382 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:20.829450 30382 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:20.829588 30382 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.034s user 0.027s sys 0.000s
I20240502 20:47:20.829916 30382 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.830024 30382 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:20.830096 30382 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.830345 30382 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:20.830955 26777 tablet_copy_service.cc:342] P b4908484400a4ce2aea341e9e1bdced3: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-51a63a79b0ee42aba9fc7bf8e8c7428e received from {username='slave'} at 127.9.82.137:43117
I20240502 20:47:20.831051 26777 tablet_copy_service.cc:433] P b4908484400a4ce2aea341e9e1bdced3: ending tablet copy session cc2b212930b84db1bb56f6952197955d-51a63a79b0ee42aba9fc7bf8e8c7428e on tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:20.907656 30382 ts_tablet_manager.cc:902] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:20.908221 30382 tablet_copy_client.cc:308] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:39463
I20240502 20:47:20.908711 26249 tablet_copy_service.cc:140] P 6173ed1979b94e509bf1c843a5183690: Received BeginTabletCopySession request for tablet 00bf11a3e1c24449bba6a09d4ab280b0 from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:46833)
I20240502 20:47:20.908851 26249 tablet_copy_service.cc:161] P 6173ed1979b94e509bf1c843a5183690: Beginning new tablet copy session on tablet 00bf11a3e1c24449bba6a09d4ab280b0 from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:46833: session id = cc2b212930b84db1bb56f6952197955d-00bf11a3e1c24449bba6a09d4ab280b0
I20240502 20:47:20.909761 26249 tablet_copy_source_session.cc:205] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:20.910698 30382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bf11a3e1c24449bba6a09d4ab280b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:20.913064 30382 tablet_copy_client.cc:783] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:20.913272 30382 tablet_copy_client.cc:647] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:20.914429 30382 tablet_copy_client.cc:523] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:20.915777 30382 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:20.937114 30382 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:20.975961 30382 tablet_bootstrap.cc:492] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:20.976194 30382 ts_tablet_manager.cc:1367] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.061s user 0.018s sys 0.005s
I20240502 20:47:20.976636 30382 raft_consensus.cc:348] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.976761 30382 raft_consensus.cc:729] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:20.976842 30382 consensus_queue.cc:260] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:20.977108 30382 ts_tablet_manager.cc:1398] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:20.977820 26249 tablet_copy_service.cc:342] P 6173ed1979b94e509bf1c843a5183690: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-00bf11a3e1c24449bba6a09d4ab280b0 received from {username='slave'} at 127.9.82.137:46833
I20240502 20:47:20.977921 26249 tablet_copy_service.cc:433] P 6173ed1979b94e509bf1c843a5183690: ending tablet copy session cc2b212930b84db1bb56f6952197955d-00bf11a3e1c24449bba6a09d4ab280b0 on tablet 00bf11a3e1c24449bba6a09d4ab280b0 with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:20.980257 30382 ts_tablet_manager.cc:902] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:20.980749 30382 tablet_copy_client.cc:308] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.134:39815
I20240502 20:47:20.984470 26645 tablet_copy_service.cc:140] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Received BeginTabletCopySession request for tablet 23d260f1c3be4dd1b18fc82af355c137 from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:53893)
I20240502 20:47:20.984593 26645 tablet_copy_service.cc:161] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Beginning new tablet copy session on tablet 23d260f1c3be4dd1b18fc82af355c137 from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:53893: session id = cc2b212930b84db1bb56f6952197955d-23d260f1c3be4dd1b18fc82af355c137
I20240502 20:47:20.985368 26645 tablet_copy_source_session.cc:205] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:20.986191 30382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d260f1c3be4dd1b18fc82af355c137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:20.988476 30382 tablet_copy_client.cc:783] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:20.988641 30382 tablet_copy_client.cc:647] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:20.989775 30382 tablet_copy_client.cc:523] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:20.990792 30382 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:21.001420 30350 ts_tablet_manager.cc:902] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:21.001955 30350 tablet_copy_client.cc:308] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:39463
I20240502 20:47:21.002453 26249 tablet_copy_service.cc:140] P 6173ed1979b94e509bf1c843a5183690: Received BeginTabletCopySession request for tablet 679352ffb9884583a0f1ee092d4badb1 from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:50069)
I20240502 20:47:21.002553 26249 tablet_copy_service.cc:161] P 6173ed1979b94e509bf1c843a5183690: Beginning new tablet copy session on tablet 679352ffb9884583a0f1ee092d4badb1 from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:50069: session id = 21a5e6dc2695447798b4a87e7c6108db-679352ffb9884583a0f1ee092d4badb1
I20240502 20:47:21.003427 26249 tablet_copy_source_session.cc:205] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:21.004313 30350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:21.006455 30350 tablet_copy_client.cc:783] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:21.006603 30350 tablet_copy_client.cc:647] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:21.007694 30350 tablet_copy_client.cc:523] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:21.008688 30350 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:21.012054 30382 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:21.012301 30382 tablet_bootstrap.cc:492] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:21.012467 30382 ts_tablet_manager.cc:1367] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.022s user 0.022s sys 0.000s
I20240502 20:47:21.012853 30382 raft_consensus.cc:348] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:21.012970 30382 raft_consensus.cc:729] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:21.013072 30382 consensus_queue.cc:260] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:21.013370 30382 ts_tablet_manager.cc:1398] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:21.013888 26645 tablet_copy_service.cc:342] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-23d260f1c3be4dd1b18fc82af355c137 received from {username='slave'} at 127.9.82.137:53893
I20240502 20:47:21.013967 26645 tablet_copy_service.cc:433] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: ending tablet copy session cc2b212930b84db1bb56f6952197955d-23d260f1c3be4dd1b18fc82af355c137 on tablet 23d260f1c3be4dd1b18fc82af355c137 with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:21.022167 28275 raft_consensus.cc:1203] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.031404 30350 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:21.031713 30350 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:21.031919 30350 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.023s user 0.023s sys 0.001s
I20240502 20:47:21.032357 30350 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:21.032554 30350 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:21.032677 30350 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:21.032989 30350 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:21.033558 26249 tablet_copy_service.cc:342] P 6173ed1979b94e509bf1c843a5183690: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-679352ffb9884583a0f1ee092d4badb1 received from {username='slave'} at 127.9.82.138:50069
I20240502 20:47:21.033653 26249 tablet_copy_service.cc:433] P 6173ed1979b94e509bf1c843a5183690: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-679352ffb9884583a0f1ee092d4badb1 on tablet 679352ffb9884583a0f1ee092d4badb1 with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:21.137293 28407 raft_consensus.cc:1203] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.188254 28407 raft_consensus.cc:1203] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.220384 28275 raft_consensus.cc:1203] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.235354 28407 raft_consensus.cc:1203] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.268571 28275 raft_consensus.cc:1203] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.367702 28407 raft_consensus.cc:1203] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.402598 28275 raft_consensus.cc:1203] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.465904 30171 raft_consensus.cc:1050] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:21.466529 30171 consensus_queue.cc:237] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:21.468407 28407 raft_consensus.cc:1203] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.469147 28275 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.469748 26229 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.469763 30529 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.469822 26095 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.469957 26624 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.470151 30528 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.470448 30529 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.470495 25962 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.471093 30529 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.471942 28145 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.472503 30528 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.472723 30171 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.474195 30526 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.474913 26624 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.476532 26755 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.476867 28275 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.477073 30420 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.477229 26229 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.477793 26096 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.479113 26755 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.480984 25823 catalog_manager.cc:5484] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.482384 25962 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.487085 28145 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.495633 28275 raft_consensus.cc:1203] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:21.601429 30136 raft_consensus.cc:1050] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:21.601928 30136 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:21.604005 26229 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.604395 28145 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.604439 25962 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.604868 30575 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.605437 26095 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.605445 30575 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.605870 26624 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.606822 26361 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.606858 30574 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.607417 30575 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.607682 30574 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.608098 28275 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.609035 30574 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.611495 30574 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.613112 30473 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.614151 25962 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.615912 26229 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.616309 26096 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.617213 28145 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.617416 26361 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.618088 25818 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:21.621968 28275 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.625267 26624 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.628618 26755 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:21.630412 26096 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.630527 26361 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.630949 30473 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.631052 26624 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.631323 30473 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.631477 30474 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.632369 25962 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.632751 30474 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.633348 28145 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.634882 28275 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.635344 30474 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.635680 30473 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.637044 30474 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.638021 28275 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.638134 28145 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.640053 25810 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:21.640008 26361 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.641633 26096 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.642143 25815 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:21.645329 26625 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.645882 26209 tablet_service.cc:1514] Processing DeleteTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with delete_type TABLET_DATA_TOMBSTONED (TS 6173ed1979b94e509bf1c843a5183690 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36658
I20240502 20:47:21.645939 25962 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.652873 30594 tablet_replica.cc:330] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: stopping tablet replica
I20240502 20:47:21.653345 30594 raft_consensus.cc:2229] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:21.653633 30594 raft_consensus.cc:2258] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:21.654943 30594 ts_tablet_manager.cc:1875] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:21.656114 30575 raft_consensus.cc:1050] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:21.656733 30575 consensus_queue.cc:237] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:21.658087 30594 ts_tablet_manager.cc:1888] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:21.658279 30594 log.cc:1196] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/51a63a79b0ee42aba9fc7bf8e8c7428e
I20240502 20:47:21.659060 26229 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.659327 26096 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.659397 28145 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.659790 25962 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.659760 30474 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.659898 26493 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.660696 25809 catalog_manager.cc:4830] TS 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463): tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (table rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]) successfully deleted
I20240502 20:47:21.661144 30576 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.661224 28275 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.661604 30577 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.661808 26361 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.661933 30577 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.662257 30577 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.662603 30577 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.663345 30576 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.668051 30575 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.668828 25962 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.670120 26493 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.672248 25821 catalog_manager.cc:5484] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.673339 28275 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.674221 26096 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.676534 28145 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.678397 26229 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.679088 26361 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.684412 26755 consensus_queue.cc:237] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:21.686138 28145 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.686426 25962 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.686942 26361 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.686933 30576 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.687043 26096 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.687332 30576 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.687486 30577 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.687563 28275 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.687650 30473 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.688275 30577 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.689281 26493 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.689827 30576 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.690323 30577 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.691161 25962 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.692176 28145 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.692909 25810 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 50134092a82f42b08ffacf2eff58b0f9 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:21.693109 28276 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.693601 26096 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.695904 25814 catalog_manager.cc:5484] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d reported cstate change: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.695923 26493 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.696357 30472 raft_consensus.cc:1050] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:21.696835 30472 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:21.695598 26361 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.700124 26209 tablet_service.cc:1514] Processing DeleteTablet for tablet 50134092a82f42b08ffacf2eff58b0f9 with delete_type TABLET_DATA_TOMBSTONED (TS 6173ed1979b94e509bf1c843a5183690 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36658
I20240502 20:47:21.700188 28144 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.700495 30594 tablet_replica.cc:330] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690: stopping tablet replica
I20240502 20:47:21.700626 30594 raft_consensus.cc:2229] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:21.700850 30594 raft_consensus.cc:2258] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:21.701534 30616 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.701735 26096 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.701742 26625 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.702312 28407 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.703215 30616 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.703518 30616 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.704411 30471 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.706094 30594 ts_tablet_manager.cc:1875] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:21.708235 26229 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.708343 30594 ts_tablet_manager.cc:1888] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:21.708825 30594 log.cc:1196] T 50134092a82f42b08ffacf2eff58b0f9 P 6173ed1979b94e509bf1c843a5183690: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/50134092a82f42b08ffacf2eff58b0f9
I20240502 20:47:21.709017 30617 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.709218 26755 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.709461 25809 catalog_manager.cc:4830] TS 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463): tablet 50134092a82f42b08ffacf2eff58b0f9 (table rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]) successfully deleted
I20240502 20:47:21.709762 30616 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.709771 25962 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.710482 30617 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.711992 30472 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.714906 26229 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.715512 28407 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.717572 26625 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.717612 26096 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.718092 25815 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db reported cstate change: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.719204 26755 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.721182 28145 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.725768 25962 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.728587 26493 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:21.730191 26625 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.730252 26755 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.730440 26096 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.730748 30617 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.730877 26229 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.730898 30471 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.731295 30471 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.731439 30617 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.731808 28407 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.732689 30471 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.735345 28145 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.735612 28407 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.735628 26096 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.736557 26625 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.738544 25817 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.737402 30617 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20240502 20:47:21.735168 30618 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.741006 28145 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.741636 25945 tablet_service.cc:1514] Processing DeleteTablet for tablet adb68aca646d42b2a869eaab1e3e805b with delete_type TABLET_DATA_TOMBSTONED (TS 3c6dc91a7df244ab82c1161799ba2ff3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:46672
I20240502 20:47:21.742913 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet adb68aca646d42b2a869eaab1e3e805b with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:21.744222 26229 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.744944 26755 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.745615 30629 tablet_replica.cc:330] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: stopping tablet replica
I20240502 20:47:21.746923 30000 raft_consensus.cc:1050] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:21.746932 30629 raft_consensus.cc:2229] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:21.747334 30629 raft_consensus.cc:2258] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:21.747506 30000 consensus_queue.cc:237] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:21.748836 30629 ts_tablet_manager.cc:1875] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:21.749802 26493 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.749933 26755 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.750185 25962 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.750319 30216 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.750689 30635 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.750926 30216 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.751060 26229 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.751190 26361 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.751459 28406 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.751809 30000 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.752303 30216 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.752465 30635 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.752730 30629 ts_tablet_manager.cc:1888] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:21.752918 30629 log.cc:1196] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/adb68aca646d42b2a869eaab1e3e805b
I20240502 20:47:21.753598 28145 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.753676 25810 catalog_manager.cc:4830] TS 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129): tablet adb68aca646d42b2a869eaab1e3e805b (table rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]) successfully deleted
I20240502 20:47:21.754869 30000 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.757234 30634 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.757695 28145 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.757798 26361 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.758920 25962 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.760928 25817 catalog_manager.cc:5484] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.760072 26755 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.764227 26493 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.764452 26229 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.766884 28407 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.769472 26096 consensus_queue.cc:237] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:21.771178 26755 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.771340 26229 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.771339 26361 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.771565 30000 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.771613 28407 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.771788 30634 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.771910 26493 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.771951 28145 raft_consensus.cc:1261] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.772166 30000 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.772370 30631 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.772621 30636 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.772958 30636 consensus_queue.cc:1035] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.774693 30000 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.775182 26755 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.775354 26493 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.776311 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ec36083ee0ce441c9b2337a48d41a5fc with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:21.777309 26229 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.777400 28145 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.778012 25814 catalog_manager.cc:5484] T ec36083ee0ce441c9b2337a48d41a5fc P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.781180 25945 tablet_service.cc:1514] Processing DeleteTablet for tablet ec36083ee0ce441c9b2337a48d41a5fc with delete_type TABLET_DATA_TOMBSTONED (TS 3c6dc91a7df244ab82c1161799ba2ff3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:46672
I20240502 20:47:21.782043 30629 tablet_replica.cc:330] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3: stopping tablet replica
I20240502 20:47:21.782209 30629 raft_consensus.cc:2229] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:21.782526 30629 raft_consensus.cc:2258] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:21.782356 28407 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.783742 30629 ts_tablet_manager.cc:1875] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:21.783514 26361 raft_consensus.cc:2932] T ec36083ee0ce441c9b2337a48d41a5fc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.786545 30629 ts_tablet_manager.cc:1888] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:21.786685 30629 log.cc:1196] T ec36083ee0ce441c9b2337a48d41a5fc P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/ec36083ee0ce441c9b2337a48d41a5fc
I20240502 20:47:21.787415 25810 catalog_manager.cc:4830] TS 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129): tablet ec36083ee0ce441c9b2337a48d41a5fc (table rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]) successfully deleted
I20240502 20:47:21.822638 30154 raft_consensus.cc:1050] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:21.823199 30154 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:21.825420 25962 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.825436 26755 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.825522 26229 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.825518 28145 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.825907 29670 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.826086 30152 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.826179 28407 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.826401 26493 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.826486 30154 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.826613 30152 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.826884 29670 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.827214 26096 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.828065 30154 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.829910 30645 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.830245 30152 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.831115 25962 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.831338 26229 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.831743 26493 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.832810 28407 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.833510 26096 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.834578 25815 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:21.836066 26755 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.836380 28145 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.845571 30645 raft_consensus.cc:1050] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:21.846040 30645 consensus_queue.cc:237] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:21.848105 26755 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.848217 28276 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.848371 26229 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.848809 30647 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.849005 30152 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.849313 29670 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.849869 28407 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.849984 25962 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.850349 29670 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.850526 30152 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.851835 26361 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.852421 29670 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.852636 26096 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.853102 30647 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.853626 30154 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.854240 26755 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.856009 28407 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.856115 28276 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.856386 25962 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.857136 25814 catalog_manager.cc:5484] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.858794 26361 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.861235 26229 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.864848 26096 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.867755 26625 consensus_queue.cc:237] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:21.869614 28276 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.869760 26755 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.869797 28407 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.870225 26361 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.870281 29670 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.870507 30154 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.870798 26096 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.870842 30646 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.871202 30646 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.871568 26229 raft_consensus.cc:1261] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.871596 30646 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.872651 30646 consensus_queue.cc:1035] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.873265 30646 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.873791 28276 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.875219 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 23d260f1c3be4dd1b18fc82af355c137 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:21.875267 26229 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.875866 26096 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.876209 26755 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.876452 28407 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.877725 26361 raft_consensus.cc:2932] T 23d260f1c3be4dd1b18fc82af355c137 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.879860 25814 catalog_manager.cc:5484] T 23d260f1c3be4dd1b18fc82af355c137 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:21.883996 25945 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d260f1c3be4dd1b18fc82af355c137 with delete_type TABLET_DATA_TOMBSTONED (TS 3c6dc91a7df244ab82c1161799ba2ff3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:46672
I20240502 20:47:21.884291 30629 tablet_replica.cc:330] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3: stopping tablet replica
I20240502 20:47:21.884459 30629 raft_consensus.cc:2229] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:21.884706 30629 raft_consensus.cc:2258] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:21.885401 30629 ts_tablet_manager.cc:1875] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:21.887823 30629 ts_tablet_manager.cc:1888] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:21.887899 30629 log.cc:1196] T 23d260f1c3be4dd1b18fc82af355c137 P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/23d260f1c3be4dd1b18fc82af355c137
I20240502 20:47:21.888638 25810 catalog_manager.cc:4830] TS 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129): tablet 23d260f1c3be4dd1b18fc82af355c137 (table rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]) successfully deleted
I20240502 20:47:21.918783 30242 raft_consensus.cc:1050] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:21.919416 30242 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:21.921311 28276 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.921326 26755 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.921752 30197 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.922112 26493 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.923390 30197 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.923550 30242 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.924396 28407 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.924456 26625 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.924798 26096 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.924825 30242 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.925701 25962 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.926982 30690 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.927624 30197 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.927989 30197 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.932099 26625 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.932490 30689 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.933537 26755 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.934042 26096 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.935988 25962 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.936208 26493 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.937321 25818 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:21.938361 28407 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.942116 28276 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.947695 26229 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:21.949822 26755 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.949928 26625 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.950135 25962 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.950251 30197 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.950443 26493 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.950596 30686 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.950762 28407 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.951260 28276 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.951656 30197 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.951871 30686 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.952096 30690 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.952262 30691 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.954293 30691 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.954661 26625 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.954990 28276 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.956048 26493 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.956943 26755 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.958271 25962 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.959050 25819 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.959945 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 679352ffb9884583a0f1ee092d4badb1 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:21.961220 28407 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.964504 26077 tablet_service.cc:1514] Processing DeleteTablet for tablet 679352ffb9884583a0f1ee092d4badb1 with delete_type TABLET_DATA_TOMBSTONED (TS 73a41df730ef429d84fe648df03a2701 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38270
I20240502 20:47:21.965560 30712 tablet_replica.cc:330] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: stopping tablet replica
I20240502 20:47:21.966207 30712 raft_consensus.cc:2229] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:21.966660 30712 raft_consensus.cc:2258] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:21.967973 30152 raft_consensus.cc:1050] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:21.968004 30712 ts_tablet_manager.cc:1875] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:21.968443 30152 consensus_queue.cc:237] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:21.970300 26096 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.970476 26229 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.970505 28145 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.970672 26361 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.970826 30152 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.970932 26493 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.971015 30154 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.971205 30647 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.971331 25965 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.971714 28407 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:21.972926 30154 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.973062 30152 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.973944 30712 ts_tablet_manager.cc:1888] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:21.974058 30712 log.cc:1196] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/679352ffb9884583a0f1ee092d4badb1
I20240502 20:47:21.974690 25808 catalog_manager.cc:4830] TS 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445): tablet 679352ffb9884583a0f1ee092d4badb1 (table rebalance_test_table_5 [id=06cebcbaacb3440d9ded604697dd88e9]) successfully deleted
I20240502 20:47:21.975191 30647 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.975481 30154 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:21.976076 30657 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.976562 25965 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.977715 28407 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.979177 26361 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.979858 26096 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.981747 25817 catalog_manager.cc:5484] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.983119 26229 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.986063 26491 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.990814 28145 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:21.992691 26625 consensus_queue.cc:237] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:21.994558 28145 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.994894 25965 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.995220 26096 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.995571 30657 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.995909 30657 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.996096 28407 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.996096 26493 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.996179 30657 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.996377 26361 raft_consensus.cc:1261] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:21.996903 30645 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.997210 30645 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:21.998847 30657 consensus_queue.cc:1035] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.000568 29670 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.001256 26361 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.001693 26096 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.002843 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f81a35dbe00342f89c4a42a3cfbbeacc with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:22.004173 26493 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.004293 25965 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.004561 25818 catalog_manager.cc:5484] T f81a35dbe00342f89c4a42a3cfbbeacc P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.005391 28145 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.003440 28407 raft_consensus.cc:2932] T f81a35dbe00342f89c4a42a3cfbbeacc P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.007912 26209 tablet_service.cc:1514] Processing DeleteTablet for tablet f81a35dbe00342f89c4a42a3cfbbeacc with delete_type TABLET_DATA_TOMBSTONED (TS 6173ed1979b94e509bf1c843a5183690 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36658
I20240502 20:47:22.008170 30594 tablet_replica.cc:330] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690: stopping tablet replica
I20240502 20:47:22.008320 30594 raft_consensus.cc:2229] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:22.008560 30594 raft_consensus.cc:2258] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:22.010357 30594 ts_tablet_manager.cc:1875] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:22.012377 30594 ts_tablet_manager.cc:1888] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:22.012450 30594 log.cc:1196] T f81a35dbe00342f89c4a42a3cfbbeacc P 6173ed1979b94e509bf1c843a5183690: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/f81a35dbe00342f89c4a42a3cfbbeacc
I20240502 20:47:22.012998 25809 catalog_manager.cc:4830] TS 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463): tablet f81a35dbe00342f89c4a42a3cfbbeacc (table rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]) successfully deleted
I20240502 20:47:22.019346 26361 consensus_queue.cc:237] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:22.021342 28145 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.021684 26229 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.021733 28276 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.021903 26096 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.021903 26624 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.022281 30732 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.022477 30527 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.022601 26755 raft_consensus.cc:1261] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.022863 30527 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.023185 30527 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.023394 30735 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.024269 30527 consensus_queue.cc:1035] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.026204 26096 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.026542 30734 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.026777 26755 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.026867 28276 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.028523 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d8efe0d8a46e47a59900e07e6430cd37 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:22.029214 26624 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.029358 28145 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.029573 25814 catalog_manager.cc:5484] T d8efe0d8a46e47a59900e07e6430cd37 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.033123 26229 raft_consensus.cc:2932] T d8efe0d8a46e47a59900e07e6430cd37 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.034165 25945 tablet_service.cc:1514] Processing DeleteTablet for tablet d8efe0d8a46e47a59900e07e6430cd37 with delete_type TABLET_DATA_TOMBSTONED (TS 3c6dc91a7df244ab82c1161799ba2ff3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:46672
I20240502 20:47:22.034425 30629 tablet_replica.cc:330] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3: stopping tablet replica
I20240502 20:47:22.034570 30629 raft_consensus.cc:2229] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:22.034826 30629 raft_consensus.cc:2258] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:22.036260 30629 ts_tablet_manager.cc:1875] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:22.038570 30629 ts_tablet_manager.cc:1888] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:22.038643 30629 log.cc:1196] T d8efe0d8a46e47a59900e07e6430cd37 P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/d8efe0d8a46e47a59900e07e6430cd37
I20240502 20:47:22.039188 25810 catalog_manager.cc:4830] TS 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129): tablet d8efe0d8a46e47a59900e07e6430cd37 (table rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]) successfully deleted
I20240502 20:47:22.054141 25962 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:22.056057 26755 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.056370 26228 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.056387 26096 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.056398 26493 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 20:47:22.056849 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cacd9a8959094a24b6f7572e973ef71f. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:22.056916 28145 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.056962 30162 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.057319 26624 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.057684 30749 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.057850 30162 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.058225 30162 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.058355 30749 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.058950 30628 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.061502 26228 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.060739 30749 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.061817 28145 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.062289 26755 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.064859 26624 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.065177 26493 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.065400 25823 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.070540 26096 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.079356 26096 consensus_queue.cc:237] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:22.081328 28145 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.081382 26755 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.081765 30631 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.081946 30000 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 20:47:22.083652 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 441da21c8ff8492c88c752ebf1233857. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:22.083652 26228 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.084126 30631 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.084610 26361 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.084970 26493 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.085011 30631 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.085321 25962 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.085727 30631 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.085950 30636 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.087774 30636 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.088364 26493 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.090790 25962 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.091641 25817 catalog_manager.cc:5484] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.093905 26228 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.094177 26755 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.110611 28145 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.111469 26361 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:22.113917 30690 raft_consensus.cc:1050] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:22.114528 30690 consensus_queue.cc:237] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:22.116688 25962 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:22.117149 28407 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:22.117229 28276 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:22.117473 30691 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:22.117648 30197 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:22.117834 30687 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:22.118113 26624 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:22.118376 26096 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:22.118965 30687 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:22.120494 26755 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:22.120659 30691 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:22.120887 30687 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:22.121595 26493 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:22.122102 30687 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:22.127517 25965 consensus_queue.cc:237] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:22.130076 28406 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.130232 26228 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.130422 26095 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.130539 26493 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.130722 26625 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.130913 30162 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.131538 30628 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.131896 30628 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.132151 30628 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.132673 26755 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:22.132863 30749 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.133806 30162 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:22.133679 30687 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.137526 26095 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.138702 28407 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.139947 28276 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.140489 25815 catalog_manager.cc:5484] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:22.141484 26757 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.142050 26491 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.145617 30749 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:22.146234 26624 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.148924 25962 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.149075 26493 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
W20240502 20:47:22.149438 25898 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf4199a73df149368fb8d04f4c9723ef. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:22.150043 25817 catalog_manager.cc:5484] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:22.150532 26228 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:22.151228 28406 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:22.153362 26096 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:22.153528 26755 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:22.158197 26228 consensus_queue.cc:237] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:22.161051 26493 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.161051 28406 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.161401 26755 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.161724 25962 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.161780 30242 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.162163 30242 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.162276 26624 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.162698 28276 raft_consensus.cc:1261] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.162815 30686 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.163125 30686 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.163619 30242 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.163962 30689 consensus_queue.cc:1035] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.166409 30242 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.167567 26624 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:22.167876 26755 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.168375 28276 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.168777 26625 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.169497 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 00bf11a3e1c24449bba6a09d4ab280b0 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:22.171448 26493 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.172106 25814 catalog_manager.cc:5484] T 00bf11a3e1c24449bba6a09d4ab280b0 P cc2b212930b84db1bb56f6952197955d reported cstate change: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.172260 28406 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.173043 25962 raft_consensus.cc:2932] T 00bf11a3e1c24449bba6a09d4ab280b0 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:22.175495 26077 tablet_service.cc:1514] Processing DeleteTablet for tablet 00bf11a3e1c24449bba6a09d4ab280b0 with delete_type TABLET_DATA_TOMBSTONED (TS 73a41df730ef429d84fe648df03a2701 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38270
I20240502 20:47:22.175765 30712 tablet_replica.cc:330] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701: stopping tablet replica
I20240502 20:47:22.175905 30712 raft_consensus.cc:2229] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:22.176154 30712 raft_consensus.cc:2258] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:22.177966 30712 ts_tablet_manager.cc:1875] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:22.180174 30712 ts_tablet_manager.cc:1888] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:22.180255 30712 log.cc:1196] T 00bf11a3e1c24449bba6a09d4ab280b0 P 73a41df730ef429d84fe648df03a2701: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/00bf11a3e1c24449bba6a09d4ab280b0
I20240502 20:47:22.180779 25808 catalog_manager.cc:4830] TS 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445): tablet 00bf11a3e1c24449bba6a09d4ab280b0 (table rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]) successfully deleted
I20240502 20:47:22.438781 26624 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:22.440769 26493 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.440871 26228 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.441107 28145 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.441354 25962 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.441406 26755 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.441560 28406 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:22.441677 30152 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.441918 30656 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.442173 30646 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.442968 30656 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.443141 30646 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.443341 30154 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:22.445576 30152 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.446259 26755 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.447686 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8659718d503141fa8a8024b700683858 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:22.448345 26228 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.449558 25817 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.449885 25962 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.450757 28406 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.453938 26493 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.456328 26077 tablet_service.cc:1514] Processing DeleteTablet for tablet 8659718d503141fa8a8024b700683858 with delete_type TABLET_DATA_TOMBSTONED (TS 73a41df730ef429d84fe648df03a2701 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38270
I20240502 20:47:22.456213 28145 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:22.456576 30712 tablet_replica.cc:330] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701: stopping tablet replica
I20240502 20:47:22.456725 30712 raft_consensus.cc:2229] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:22.456950 30712 raft_consensus.cc:2258] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:22.457937 30712 ts_tablet_manager.cc:1875] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:22.461172 30712 ts_tablet_manager.cc:1888] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:22.461354 30712 log.cc:1196] T 8659718d503141fa8a8024b700683858 P 73a41df730ef429d84fe648df03a2701: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/8659718d503141fa8a8024b700683858
I20240502 20:47:22.462040 25808 catalog_manager.cc:4830] TS 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445): tablet 8659718d503141fa8a8024b700683858 (table rebalance_test_table_1 [id=0e250900084e4d32ad5f3360818187fb]) successfully deleted
I20240502 20:47:22.471055 30859 ts_tablet_manager.cc:902] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:22.471652 30859 tablet_copy_client.cc:308] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:34445
I20240502 20:47:22.472249 26116 tablet_copy_service.cc:140] P 73a41df730ef429d84fe648df03a2701: Received BeginTabletCopySession request for tablet 441da21c8ff8492c88c752ebf1233857 from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:47281)
I20240502 20:47:22.472376 26116 tablet_copy_service.cc:161] P 73a41df730ef429d84fe648df03a2701: Beginning new tablet copy session on tablet 441da21c8ff8492c88c752ebf1233857 from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:47281: session id = 21a5e6dc2695447798b4a87e7c6108db-441da21c8ff8492c88c752ebf1233857
I20240502 20:47:22.473349 26116 tablet_copy_source_session.cc:205] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:22.474385 30859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441da21c8ff8492c88c752ebf1233857. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:22.476948 30859 tablet_copy_client.cc:783] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:22.477110 30859 tablet_copy_client.cc:647] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:22.478358 30859 tablet_copy_client.cc:523] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:22.479416 30859 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:22.506218 30859 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:22.506573 30859 tablet_bootstrap.cc:492] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:22.506829 30859 ts_tablet_manager.cc:1367] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.027s user 0.025s sys 0.000s
I20240502 20:47:22.507298 30859 raft_consensus.cc:348] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:22.507452 30859 raft_consensus.cc:729] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:22.507570 30859 consensus_queue.cc:260] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:22.507902 30859 ts_tablet_manager.cc:1398] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:22.508795 26116 tablet_copy_service.cc:342] P 73a41df730ef429d84fe648df03a2701: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-441da21c8ff8492c88c752ebf1233857 received from {username='slave'} at 127.9.82.138:47281
I20240502 20:47:22.508878 26116 tablet_copy_service.cc:433] P 73a41df730ef429d84fe648df03a2701: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-441da21c8ff8492c88c752ebf1233857 on tablet 441da21c8ff8492c88c752ebf1233857 with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:22.580271 30859 ts_tablet_manager.cc:902] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129)
I20240502 20:47:22.580789 30859 tablet_copy_client.cc:308] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:37129
I20240502 20:47:22.581296 25985 tablet_copy_service.cc:140] P 3c6dc91a7df244ab82c1161799ba2ff3: Received BeginTabletCopySession request for tablet cacd9a8959094a24b6f7572e973ef71f from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:43921)
I20240502 20:47:22.581444 25985 tablet_copy_service.cc:161] P 3c6dc91a7df244ab82c1161799ba2ff3: Beginning new tablet copy session on tablet cacd9a8959094a24b6f7572e973ef71f from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:43921: session id = 21a5e6dc2695447798b4a87e7c6108db-cacd9a8959094a24b6f7572e973ef71f
I20240502 20:47:22.582274 25985 tablet_copy_source_session.cc:205] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:22.583209 30859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:22.584975 30859 tablet_copy_client.cc:783] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:22.585129 30859 tablet_copy_client.cc:647] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:22.586323 30859 tablet_copy_client.cc:523] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:22.587348 30859 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:22.606109 30859 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:22.606434 30859 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:22.606631 30859 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.019s user 0.017s sys 0.000s
I20240502 20:47:22.607084 30859 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:22.607208 30859 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:22.607298 30859 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:22.607589 30859 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:22.608299 25985 tablet_copy_service.cc:342] P 3c6dc91a7df244ab82c1161799ba2ff3: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-cacd9a8959094a24b6f7572e973ef71f received from {username='slave'} at 127.9.82.138:43921
I20240502 20:47:22.608393 25985 tablet_copy_service.cc:433] P 3c6dc91a7df244ab82c1161799ba2ff3: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-cacd9a8959094a24b6f7572e973ef71f on tablet cacd9a8959094a24b6f7572e973ef71f with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:22.714049 30890 ts_tablet_manager.cc:902] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129)
I20240502 20:47:22.714597 30890 tablet_copy_client.cc:308] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:37129
I20240502 20:47:22.720340 25985 tablet_copy_service.cc:140] P 3c6dc91a7df244ab82c1161799ba2ff3: Received BeginTabletCopySession request for tablet bf4199a73df149368fb8d04f4c9723ef from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:55997)
I20240502 20:47:22.720455 25985 tablet_copy_service.cc:161] P 3c6dc91a7df244ab82c1161799ba2ff3: Beginning new tablet copy session on tablet bf4199a73df149368fb8d04f4c9723ef from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:55997: session id = cc2b212930b84db1bb56f6952197955d-bf4199a73df149368fb8d04f4c9723ef
I20240502 20:47:22.721307 25985 tablet_copy_source_session.cc:205] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:22.722390 30890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf4199a73df149368fb8d04f4c9723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:22.726269 30890 tablet_copy_client.cc:783] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:22.726428 30890 tablet_copy_client.cc:647] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:22.727633 30890 tablet_copy_client.cc:523] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:22.728947 30890 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:22.751837 30890 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:22.752175 30890 tablet_bootstrap.cc:492] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:22.752378 30890 ts_tablet_manager.cc:1367] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.023s user 0.023s sys 0.000s
I20240502 20:47:22.752877 30890 raft_consensus.cc:348] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:22.753046 30890 raft_consensus.cc:729] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:22.753155 30890 consensus_queue.cc:260] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:22.753582 30890 ts_tablet_manager.cc:1398] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:22.754319 25985 tablet_copy_service.cc:342] P 3c6dc91a7df244ab82c1161799ba2ff3: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-bf4199a73df149368fb8d04f4c9723ef received from {username='slave'} at 127.9.82.137:55997
I20240502 20:47:22.754415 25985 tablet_copy_service.cc:433] P 3c6dc91a7df244ab82c1161799ba2ff3: ending tablet copy session cc2b212930b84db1bb56f6952197955d-bf4199a73df149368fb8d04f4c9723ef on tablet bf4199a73df149368fb8d04f4c9723ef with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:22.877779 28406 raft_consensus.cc:1203] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:22.987210 28406 raft_consensus.cc:1203] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:23.239567 28275 raft_consensus.cc:1203] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:23.321316 30914 raft_consensus.cc:1050] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:23.321826 30914 consensus_queue.cc:237] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:23.324129 28145 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.324203 25962 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.324381 26359 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.324672 30952 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.324730 26228 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.324925 30953 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.325907 28406 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.326318 30953 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.326673 30954 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.326817 30953 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.327098 26755 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.327838 26493 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.328336 30954 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.328681 30953 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.331197 30951 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.331336 26361 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.331640 26757 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.333185 26493 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.334964 28145 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.334972 25962 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.335929 25817 catalog_manager.cc:5484] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:23.336954 26228 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.339144 28406 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.347996 26096 consensus_queue.cc:237] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:23.349977 26493 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.350392 30952 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.350529 26228 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.350534 28406 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.351131 30954 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.351336 30952 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.352201 28145 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.352607 26361 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.352609 26755 raft_consensus.cc:1261] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.353137 30952 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.353298 30953 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.353459 30954 consensus_queue.cc:1035] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.354997 30954 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.355993 28145 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.356081 26755 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.356964 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 441da21c8ff8492c88c752ebf1233857 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:23.357765 28406 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.358063 26493 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.359136 25823 catalog_manager.cc:5484] T 441da21c8ff8492c88c752ebf1233857 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.362314 25945 tablet_service.cc:1514] Processing DeleteTablet for tablet 441da21c8ff8492c88c752ebf1233857 with delete_type TABLET_DATA_TOMBSTONED (TS 3c6dc91a7df244ab82c1161799ba2ff3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:46672
I20240502 20:47:23.362758 30966 tablet_replica.cc:330] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3: stopping tablet replica
I20240502 20:47:23.363001 30966 raft_consensus.cc:2229] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:23.362875 26228 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.363247 30966 raft_consensus.cc:2258] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:23.365068 26361 raft_consensus.cc:2932] T 441da21c8ff8492c88c752ebf1233857 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.365418 30966 ts_tablet_manager.cc:1875] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:23.367569 30966 ts_tablet_manager.cc:1888] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:23.367646 30966 log.cc:1196] T 441da21c8ff8492c88c752ebf1233857 P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-0/wal/wals/441da21c8ff8492c88c752ebf1233857
I20240502 20:47:23.368214 25810 catalog_manager.cc:4830] TS 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129): tablet 441da21c8ff8492c88c752ebf1233857 (table rebalance_test_table_4 [id=681798fd52dd4cfe82253b6ce74de2ca]) successfully deleted
I20240502 20:47:23.559513 30932 raft_consensus.cc:1050] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: attempting to promote NON_VOTER 21a5e6dc2695447798b4a87e7c6108db to VOTER
I20240502 20:47:23.560178 30932 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:23.562659 28145 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.562845 26228 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.563110 26493 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.563239 26755 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.563817 30784 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.564071 26624 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.564177 26096 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.564185 28407 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.564227 30784 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.564548 30784 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.564668 30931 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.564843 30995 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.565586 30784 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.566489 30994 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.568423 30994 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.568929 28145 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.569386 26228 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.570003 26493 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.571586 28407 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.572552 26624 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.573338 25814 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.574101 26755 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.577605 26096 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.581849 25962 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } }
I20240502 20:47:23.583590 26624 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.583633 26493 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.583619 26755 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.583777 28145 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.584188 28407 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.584160 30932 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.584440 30784 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.584630 26096 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.584671 30932 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.585880 30932 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.586032 30784 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.586189 30931 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.587651 30784 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.588213 28145 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.589440 28407 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.590039 25810 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet cacd9a8959094a24b6f7572e973ef71f with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:23.590205 26624 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.590673 26491 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.591120 25818 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:23.591468 26755 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.592746 26096 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } }
I20240502 20:47:23.594844 26209 tablet_service.cc:1514] Processing DeleteTablet for tablet cacd9a8959094a24b6f7572e973ef71f with delete_type TABLET_DATA_TOMBSTONED (TS 6173ed1979b94e509bf1c843a5183690 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36658
I20240502 20:47:23.595307 31003 tablet_replica.cc:330] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690: stopping tablet replica
I20240502 20:47:23.595539 31003 raft_consensus.cc:2229] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:23.595868 31003 raft_consensus.cc:2258] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:23.596645 31003 ts_tablet_manager.cc:1875] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:23.598994 31003 ts_tablet_manager.cc:1888] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:23.599069 31003 log.cc:1196] T cacd9a8959094a24b6f7572e973ef71f P 6173ed1979b94e509bf1c843a5183690: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-2/wal/wals/cacd9a8959094a24b6f7572e973ef71f
I20240502 20:47:23.599645 25809 catalog_manager.cc:4830] TS 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463): tablet cacd9a8959094a24b6f7572e973ef71f (table rebalance_test_table_2 [id=4b6bf3ec0f824523b3f89e12f8c23ea9]) successfully deleted
I20240502 20:47:23.827950 30931 raft_consensus.cc:1050] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:23.828469 30931 consensus_queue.cc:237] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:23.830407 26491 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.830407 26228 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.830417 28275 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.830761 28407 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.830896 31020 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.831336 26757 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.831385 26624 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.831375 31021 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.831611 30932 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.831806 30994 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.831914 30784 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.832983 30932 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.833637 26096 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:23.833992 30932 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:23.835887 30932 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.836872 28407 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.837385 26755 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.838315 28275 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.838480 26096 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.838948 26624 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.840559 25821 catalog_manager.cc:5484] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db reported cstate change: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.843034 26491 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.843421 26228 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.850257 25962 consensus_queue.cc:237] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:23.852327 28275 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.852531 28407 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.852638 26624 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.852730 30993 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.853171 26755 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.853364 26228 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.853480 26491 raft_consensus.cc:1261] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:23.853747 30931 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.853929 30995 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.854138 31020 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.854290 30994 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.854439 30993 consensus_queue.cc:1035] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:23.856405 30993 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.856914 26624 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.857766 26228 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.858644 26755 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.859803 28407 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.860446 25810 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet bf4199a73df149368fb8d04f4c9723ef with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:23.860945 25818 catalog_manager.cc:5484] T bf4199a73df149368fb8d04f4c9723ef P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.861280 28275 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.862043 26491 raft_consensus.cc:2932] T bf4199a73df149368fb8d04f4c9723ef P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:23.864720 26077 tablet_service.cc:1514] Processing DeleteTablet for tablet bf4199a73df149368fb8d04f4c9723ef with delete_type TABLET_DATA_TOMBSTONED (TS 73a41df730ef429d84fe648df03a2701 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38270
I20240502 20:47:23.867305 31037 tablet_replica.cc:330] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: stopping tablet replica
I20240502 20:47:23.867763 31037 raft_consensus.cc:2229] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:23.868021 31037 raft_consensus.cc:2258] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:23.868880 31037 ts_tablet_manager.cc:1875] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:23.870666 31037 ts_tablet_manager.cc:1888] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:23.870738 31037 log.cc:1196] T bf4199a73df149368fb8d04f4c9723ef P 73a41df730ef429d84fe648df03a2701: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/bf4199a73df149368fb8d04f4c9723ef
I20240502 20:47:23.871338 25808 catalog_manager.cc:4830] TS 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445): tablet bf4199a73df149368fb8d04f4c9723ef (table rebalance_test_table_0 [id=f5f0502555304ef0930e5f9b94bb42cb]) successfully deleted
I20240502 20:47:24.151914 28387 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:24.153676 25945 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:24.153741 26604 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:24.166131 28125 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:24.166814 26209 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:24.179845 26736 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:24.184690 26077 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:47:24.195662 26471 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:24.207147 28256 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:24.207455 26341 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:47:24.329079 28387 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:24.330590 28125 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:24.331164 25945 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:24.337425 28256 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:24.346999 26736 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:24.349946 26077 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:47:24.365679 26471 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:24.372471 26604 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:24.393895 26341 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:47:24.399066 26209 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:24.439090 26361 consensus_queue.cc:237] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } }
I20240502 20:47:24.441964 26757 consensus_queue.cc:237] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:24.442087 26228 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.442900 28407 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.443074 26096 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.443397 31170 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.443940 25965 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.444156 28275 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.444254 26755 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.445037 30576 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.445120 31170 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.445433 31170 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.445514 26096 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.445895 30576 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.446069 26491 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.446445 28145 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.446489 31170 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.447659 30576 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.448000 25965 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.448020 30576 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.448330 31038 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 20:47:24.448889 26296 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495): Couldn't send request to peer 9aaa16c4fc46478f90a3d97b010330c2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.448874 31175 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.449353 26624 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.449918 31038 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.452488 26361 raft_consensus.cc:1261] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.453534 31030 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.454041 26096 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.455821 31169 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } } }
I20240502 20:47:24.456564 28145 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.456971 25821 catalog_manager.cc:5484] T 50134092a82f42b08ffacf2eff58b0f9 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 10 to 11, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.455669 31030 consensus_queue.cc:1035] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.458945 26755 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } }
I20240502 20:47:24.460769 28407 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } } }
I20240502 20:47:24.461479 26361 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.463179 28275 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.463587 25962 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.464941 28276 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.465428 25965 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } } }
I20240502 20:47:24.466300 26096 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.466290 26624 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.466701 28144 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.467396 25965 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.468060 31176 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.467957 26491 raft_consensus.cc:2932] T 50134092a82f42b08ffacf2eff58b0f9 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.468884 30576 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.468369 26228 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } } }
I20240502 20:47:24.469422 31176 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.471138 26359 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
W20240502 20:47:24.471462 26692 consensus_peers.cc:485] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 -> Peer 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463): Couldn't send request to peer 6173ed1979b94e509bf1c843a5183690. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.473647 25818 catalog_manager.cc:5484] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 7 to 8, NON_VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) added. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } } }
I20240502 20:47:24.480177 31176 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20240502 20:47:24.480605 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50134092a82f42b08ffacf2eff58b0f9. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.480809 31176 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.481091 31172 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.481421 26757 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } } }
I20240502 20:47:24.484819 26493 consensus_queue.cc:237] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:24.487593 26229 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.487792 28276 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.487850 25962 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.488188 31219 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.488627 26095 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.488600 30949 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.488940 30949 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.489089 26625 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 20:47:24.489917 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe3671f95cd0488cbdf684011ad3d1e3. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.489918 31219 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.490387 31219 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.491158 26757 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.492220 30949 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.494894 26625 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } } }
I20240502 20:47:24.495352 26094 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } } }
I20240502 20:47:24.495924 31172 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } } }
I20240502 20:47:24.498261 28275 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } } }
I20240502 20:47:24.498778 25965 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } } }
I20240502 20:47:24.499228 26624 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } } }
I20240502 20:47:24.501647 25819 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d reported cstate change: config changed from index 10 to 11, NON_VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) added. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } } }
I20240502 20:47:24.504813 26359 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } } }
I20240502 20:47:24.508189 28144 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } } }
I20240502 20:47:24.508584 31218 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.511749 28276 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.514925 26229 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.514995 26624 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.517565 25818 catalog_manager.cc:5484] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 reported cstate change: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.518116 25962 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.521690 26757 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.523397 26096 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } } }
I20240502 20:47:24.533918 26493 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } }
I20240502 20:47:24.534446 26095 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } }
I20240502 20:47:24.537935 26229 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.538123 28144 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.539114 30949 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20240502 20:47:24.539302 26429 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129): Couldn't send request to peer 3c6dc91a7df244ab82c1161799ba2ff3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.539496 30949 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.540215 28407 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.540601 26624 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.541283 26096 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.541386 26757 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.541827 31219 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.542371 31219 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.542696 31221 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.543680 31219 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.548017 26624 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:24.550182 28145 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
W20240502 20:47:24.550535 26558 consensus_peers.cc:485] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8659718d503141fa8a8024b700683858. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.550590 26755 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.550895 31148 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.551503 30646 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.551807 26493 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.552139 26228 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.552417 31257 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.552788 31257 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.554030 28406 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.554965 25962 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.555346 31148 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.555548 30646 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.557088 31219 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } } }
I20240502 20:47:24.558254 31257 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.558610 26757 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.560045 25962 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.560632 26757 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } } }
I20240502 20:47:24.561058 25819 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 10 to 11, NON_VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) added. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:24.561658 26493 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.563223 28144 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } } }
I20240502 20:47:24.563831 26229 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } } }
I20240502 20:47:24.566716 28407 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } } }
I20240502 20:47:24.567283 25815 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 10 to 11, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:24.567538 26229 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.570097 26096 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } } }
I20240502 20:47:24.570974 28144 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.571938 26624 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } } }
I20240502 20:47:24.575183 28406 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.584105 26229 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } }
I20240502 20:47:24.586315 28276 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
W20240502 20:47:24.586661 26163 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 -> Peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445): Couldn't send request to peer 73a41df730ef429d84fe648df03a2701. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.586719 30686 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.587760 26624 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.587778 26757 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.588467 28406 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.588521 26493 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.588986 30686 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.589392 31265 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.589560 30686 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.589879 30686 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.590761 25962 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.591405 31278 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.594223 31278 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } } }
I20240502 20:47:24.595894 26493 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } } }
I20240502 20:47:24.596958 28276 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } } }
I20240502 20:47:24.598471 26624 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } } }
I20240502 20:47:24.598546 28406 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } } }
I20240502 20:47:24.599856 25821 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 10 to 11, NON_VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) added. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } } }
I20240502 20:47:24.605453 26359 consensus_queue.cc:237] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:24.605423 26757 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } } }
I20240502 20:47:24.605520 25962 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } } }
I20240502 20:47:24.608740 26096 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.609146 28406 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 20:47:24.609165 26294 consensus_peers.cc:485] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891): Couldn't send request to peer cc2b212930b84db1bb56f6952197955d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e25072f604644d9595c95c1bd5bfd7db. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.609668 31166 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.610219 31169 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.610591 26229 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.611485 26757 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.611505 31169 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.612093 31169 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.612152 25962 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.612694 26493 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.614092 31169 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.614682 31169 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.616809 31169 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.618036 26096 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.619544 28406 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.621712 26757 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.621712 26493 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.622215 25818 catalog_manager.cc:5484] T e25072f604644d9595c95c1bd5bfd7db P 21a5e6dc2695447798b4a87e7c6108db reported cstate change: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.625241 26229 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.631803 25962 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER cc2b212930b84db1bb56f6952197955d (127.9.82.137) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } } }
I20240502 20:47:24.682404 25945 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:24.683826 28387 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:24.694264 26209 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:24.696085 28125 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:24.696756 26341 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 20:47:24.698742 26077 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 20:47:24.699090 26736 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 20:47:24.714283 26471 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:24.723358 26604 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 20:47:24.724011 28256 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 20:47:24.786005 26493 consensus_queue.cc:237] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } }
I20240502 20:47:24.788118 26757 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:24.788110 26096 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:24.788290 25962 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:24.788674 26625 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:24.788717 31249 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:24.788933 28276 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:24.788918 31222 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:24.789259 31222 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:24.789521 31222 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:24.789705 31220 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20240502 20:47:24.791628 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe3671f95cd0488cbdf684011ad3d1e3. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.791759 31219 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
W20240502 20:47:24.792868 26428 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): Couldn't send request to peer bbee1301f7b94c6ab339ecaccc4ce740. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.793279 25962 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.793684 26229 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:24.794096 26757 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.794332 26096 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.796046 28276 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.796870 25814 catalog_manager.cc:5484] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 8 to 9, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.797727 31249 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:24.798852 26229 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.803278 26625 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.809584 26493 consensus_queue.cc:237] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } }
I20240502 20:47:24.811699 26096 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.811920 26229 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.811993 25962 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.812147 26359 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.812371 26757 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.812498 31220 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.812697 31248 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.812739 28276 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.812844 31222 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.812938 31249 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.813087 31247 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.813256 31221 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 20:47:24.814191 26427 consensus_peers.cc:485] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815): Couldn't send request to peer 4855f9c9a7f64986b4a0eb21e1ef6f0a. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.816982 31220 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } } }
I20240502 20:47:24.817466 28276 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } } }
I20240502 20:47:24.818337 25962 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } } }
I20240502 20:47:24.819551 26096 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } } }
I20240502 20:47:24.820173 26359 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } } }
I20240502 20:47:24.820389 26757 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } } }
I20240502 20:47:24.820448 25815 catalog_manager.cc:5484] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 7 to 8, NON_VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) added. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:24.819286 26229 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } } }
I20240502 20:47:24.834098 25962 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } }
W20240502 20:47:24.836453 25900 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): Couldn't send request to peer bbee1301f7b94c6ab339ecaccc4ce740. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.836454 26493 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.836481 28144 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.836882 26757 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.836882 28406 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.836890 26096 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.837288 26625 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:24.837442 31385 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.837641 30931 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.837843 31202 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.837978 31383 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.838261 31385 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.839134 31384 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:24.840891 31384 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.842511 28144 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.843135 26757 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.843305 26493 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.846163 25814 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 10 to 11, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.847404 26625 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.848340 26096 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.855641 28406 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.857316 26096 consensus_queue.cc:237] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } }
I20240502 20:47:24.859526 28406 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.860160 26493 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.860605 26757 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.860694 25962 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.861105 31399 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.861310 30952 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.861562 31399 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.861692 26229 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.862017 26625 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 20:47:24.862231 30952 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.862498 31399 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.863329 31404 ts_tablet_manager.cc:902] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Initiating tablet copy from peer b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
W20240502 20:47:24.864140 26032 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125): Couldn't send request to peer bbee1301f7b94c6ab339ecaccc4ce740. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:24.864477 31404 tablet_copy_client.cc:308] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.135:39673
I20240502 20:47:24.864507 31399 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 20:47:24.865034 26777 tablet_copy_service.cc:140] P b4908484400a4ce2aea341e9e1bdced3: Received BeginTabletCopySession request for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e from peer 6173ed1979b94e509bf1c843a5183690 ({username='slave'} at 127.9.82.131:54491)
I20240502 20:47:24.865147 26777 tablet_copy_service.cc:161] P b4908484400a4ce2aea341e9e1bdced3: Beginning new tablet copy session on tablet 51a63a79b0ee42aba9fc7bf8e8c7428e from peer 6173ed1979b94e509bf1c843a5183690 at {username='slave'} at 127.9.82.131:54491: session id = 6173ed1979b94e509bf1c843a5183690-51a63a79b0ee42aba9fc7bf8e8c7428e
I20240502 20:47:24.866101 26777 tablet_copy_source_session.cc:205] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:24.866564 30952 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.867277 31404 ts_tablet_manager.cc:1875] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 20:47:24.868006 25962 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.868005 26229 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.869424 26625 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.869764 26493 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.872421 31404 ts_tablet_manager.cc:1888] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.9
I20240502 20:47:24.872422 25819 catalog_manager.cc:5484] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 reported cstate change: config changed from index 7 to 8, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.872613 31404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:24.876636 26757 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.877671 31404 tablet_copy_client.cc:783] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:24.877883 31404 tablet_copy_client.cc:647] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:24.880292 31404 tablet_copy_client.cc:523] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:24.881978 28406 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 21a5e6dc2695447798b4a87e7c6108db [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } } }
I20240502 20:47:24.889011 31404 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Bootstrap starting.
I20240502 20:47:24.933909 31404 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:24.934259 31404 tablet_bootstrap.cc:492] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Bootstrap complete.
I20240502 20:47:24.934448 31404 ts_tablet_manager.cc:1367] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Time spent bootstrapping tablet: real 0.046s user 0.029s sys 0.002s
I20240502 20:47:24.935611 31404 raft_consensus.cc:348] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } }
I20240502 20:47:24.935798 31404 raft_consensus.cc:729] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Initialized, Role: LEARNER
I20240502 20:47:24.935899 31404 consensus_queue.cc:260] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: NON_VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: true } }
I20240502 20:47:24.936324 31404 ts_tablet_manager.cc:1398] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 20:47:24.936846 26777 tablet_copy_service.cc:342] P b4908484400a4ce2aea341e9e1bdced3: Request end of tablet copy session 6173ed1979b94e509bf1c843a5183690-51a63a79b0ee42aba9fc7bf8e8c7428e received from {username='slave'} at 127.9.82.131:54491
I20240502 20:47:24.936923 26777 tablet_copy_service.cc:433] P b4908484400a4ce2aea341e9e1bdced3: ending tablet copy session 6173ed1979b94e509bf1c843a5183690-51a63a79b0ee42aba9fc7bf8e8c7428e on tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with peer 6173ed1979b94e509bf1c843a5183690
I20240502 20:47:24.952535 31465 ts_tablet_manager.cc:902] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Initiating tablet copy from peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:24.953483 31465 tablet_copy_client.cc:308] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:37495
I20240502 20:47:24.954154 26513 tablet_copy_service.cc:140] P 9aaa16c4fc46478f90a3d97b010330c2: Received BeginTabletCopySession request for tablet adb68aca646d42b2a869eaab1e3e805b from peer 3c6dc91a7df244ab82c1161799ba2ff3 ({username='slave'} at 127.9.82.129:54153)
I20240502 20:47:24.954272 26513 tablet_copy_service.cc:161] P 9aaa16c4fc46478f90a3d97b010330c2: Beginning new tablet copy session on tablet adb68aca646d42b2a869eaab1e3e805b from peer 3c6dc91a7df244ab82c1161799ba2ff3 at {username='slave'} at 127.9.82.129:54153: session id = 3c6dc91a7df244ab82c1161799ba2ff3-adb68aca646d42b2a869eaab1e3e805b
I20240502 20:47:24.955299 26513 tablet_copy_source_session.cc:205] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:24.956753 31465 ts_tablet_manager.cc:1875] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 20:47:24.959331 31465 ts_tablet_manager.cc:1888] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.9
I20240502 20:47:24.959630 31465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adb68aca646d42b2a869eaab1e3e805b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:24.961503 31465 tablet_copy_client.cc:783] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:24.961701 31465 tablet_copy_client.cc:647] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:24.963399 31465 tablet_copy_client.cc:523] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:24.965073 31465 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap starting.
I20240502 20:47:24.988406 31465 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:24.988723 31465 tablet_bootstrap.cc:492] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Bootstrap complete.
I20240502 20:47:24.988899 31465 ts_tablet_manager.cc:1367] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent bootstrapping tablet: real 0.024s user 0.023s sys 0.000s
I20240502 20:47:24.989290 31465 raft_consensus.cc:348] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } }
I20240502 20:47:24.989416 31465 raft_consensus.cc:729] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3c6dc91a7df244ab82c1161799ba2ff3, State: Initialized, Role: LEARNER
I20240502 20:47:24.989516 31465 consensus_queue.cc:260] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: NON_VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: true } }
I20240502 20:47:24.989794 31465 ts_tablet_manager.cc:1398] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:24.990391 26513 tablet_copy_service.cc:342] P 9aaa16c4fc46478f90a3d97b010330c2: Request end of tablet copy session 3c6dc91a7df244ab82c1161799ba2ff3-adb68aca646d42b2a869eaab1e3e805b received from {username='slave'} at 127.9.82.129:54153
I20240502 20:47:24.990473 26513 tablet_copy_service.cc:433] P 9aaa16c4fc46478f90a3d97b010330c2: ending tablet copy session 3c6dc91a7df244ab82c1161799ba2ff3-adb68aca646d42b2a869eaab1e3e805b on tablet adb68aca646d42b2a869eaab1e3e805b with peer 3c6dc91a7df244ab82c1161799ba2ff3
I20240502 20:47:25.051849 31481 ts_tablet_manager.cc:902] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Initiating tablet copy from peer 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463)
I20240502 20:47:25.052661 31481 tablet_copy_client.cc:308] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.131:39463
I20240502 20:47:25.053239 26249 tablet_copy_service.cc:140] P 6173ed1979b94e509bf1c843a5183690: Received BeginTabletCopySession request for tablet 679352ffb9884583a0f1ee092d4badb1 from peer 73a41df730ef429d84fe648df03a2701 ({username='slave'} at 127.9.82.130:42261)
I20240502 20:47:25.053342 26249 tablet_copy_service.cc:161] P 6173ed1979b94e509bf1c843a5183690: Beginning new tablet copy session on tablet 679352ffb9884583a0f1ee092d4badb1 from peer 73a41df730ef429d84fe648df03a2701 at {username='slave'} at 127.9.82.130:42261: session id = 73a41df730ef429d84fe648df03a2701-679352ffb9884583a0f1ee092d4badb1
I20240502 20:47:25.054185 26249 tablet_copy_source_session.cc:205] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:25.055164 31481 ts_tablet_manager.cc:1875] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 20:47:25.057157 31481 ts_tablet_manager.cc:1888] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.9
I20240502 20:47:25.057360 31481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 679352ffb9884583a0f1ee092d4badb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:25.057677 31486 ts_tablet_manager.cc:902] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673)
I20240502 20:47:25.058264 31486 tablet_copy_client.cc:308] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.135:39673
I20240502 20:47:25.058786 31481 tablet_copy_client.cc:783] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:25.058959 31481 tablet_copy_client.cc:647] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:25.060580 31481 tablet_copy_client.cc:523] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:25.062192 31481 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Bootstrap starting.
I20240502 20:47:25.062750 26777 tablet_copy_service.cc:140] P b4908484400a4ce2aea341e9e1bdced3: Received BeginTabletCopySession request for tablet 50134092a82f42b08ffacf2eff58b0f9 from peer 21a5e6dc2695447798b4a87e7c6108db ({username='slave'} at 127.9.82.138:34787)
I20240502 20:47:25.062858 26777 tablet_copy_service.cc:161] P b4908484400a4ce2aea341e9e1bdced3: Beginning new tablet copy session on tablet 50134092a82f42b08ffacf2eff58b0f9 from peer 21a5e6dc2695447798b4a87e7c6108db at {username='slave'} at 127.9.82.138:34787: session id = 21a5e6dc2695447798b4a87e7c6108db-50134092a82f42b08ffacf2eff58b0f9
I20240502 20:47:25.063942 26777 tablet_copy_source_session.cc:205] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:25.064922 31486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50134092a82f42b08ffacf2eff58b0f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:25.065562 31492 ts_tablet_manager.cc:902] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Initiating tablet copy from peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125)
I20240502 20:47:25.066740 31492 tablet_copy_client.cc:308] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:43125
I20240502 20:47:25.067159 31486 tablet_copy_client.cc:783] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:25.067303 31486 tablet_copy_client.cc:647] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:25.067414 26381 tablet_copy_service.cc:140] P bbee1301f7b94c6ab339ecaccc4ce740: Received BeginTabletCopySession request for tablet 406675832bd84f4ea6de10c0ae14ec53 from peer 9aaa16c4fc46478f90a3d97b010330c2 ({username='slave'} at 127.9.82.133:56461)
I20240502 20:47:25.067519 26381 tablet_copy_service.cc:161] P bbee1301f7b94c6ab339ecaccc4ce740: Beginning new tablet copy session on tablet 406675832bd84f4ea6de10c0ae14ec53 from peer 9aaa16c4fc46478f90a3d97b010330c2 at {username='slave'} at 127.9.82.133:56461: session id = 9aaa16c4fc46478f90a3d97b010330c2-406675832bd84f4ea6de10c0ae14ec53
I20240502 20:47:25.068449 26381 tablet_copy_source_session.cc:205] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:25.069366 31492 ts_tablet_manager.cc:1875] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 20:47:25.069448 31486 tablet_copy_client.cc:523] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:25.070760 31486 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap starting.
I20240502 20:47:25.071362 31492 ts_tablet_manager.cc:1888] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 20:47:25.071535 31492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 406675832bd84f4ea6de10c0ae14ec53. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:25.072957 31492 tablet_copy_client.cc:783] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:25.073134 31492 tablet_copy_client.cc:647] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:25.077296 31492 tablet_copy_client.cc:523] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:25.078898 31492 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap starting.
I20240502 20:47:25.096071 31481 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:25.096428 31481 tablet_bootstrap.cc:492] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Bootstrap complete.
I20240502 20:47:25.096652 31481 ts_tablet_manager.cc:1367] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Time spent bootstrapping tablet: real 0.035s user 0.028s sys 0.004s
I20240502 20:47:25.097133 31481 raft_consensus.cc:348] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } }
I20240502 20:47:25.097292 31481 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73a41df730ef429d84fe648df03a2701, State: Initialized, Role: LEARNER
I20240502 20:47:25.097400 31481 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: NON_VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: true } }
I20240502 20:47:25.097819 31481 ts_tablet_manager.cc:1398] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 20:47:25.098711 26249 tablet_copy_service.cc:342] P 6173ed1979b94e509bf1c843a5183690: Request end of tablet copy session 73a41df730ef429d84fe648df03a2701-679352ffb9884583a0f1ee092d4badb1 received from {username='slave'} at 127.9.82.130:42261
I20240502 20:47:25.098803 26249 tablet_copy_service.cc:433] P 6173ed1979b94e509bf1c843a5183690: ending tablet copy session 73a41df730ef429d84fe648df03a2701-679352ffb9884583a0f1ee092d4badb1 on tablet 679352ffb9884583a0f1ee092d4badb1 with peer 73a41df730ef429d84fe648df03a2701
I20240502 20:47:25.103049 31486 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:25.103360 31486 tablet_bootstrap.cc:492] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: Bootstrap complete.
I20240502 20:47:25.103566 31486 ts_tablet_manager.cc:1367] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: Time spent bootstrapping tablet: real 0.033s user 0.023s sys 0.005s
I20240502 20:47:25.104007 31486 raft_consensus.cc:348] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:25.104161 31486 raft_consensus.cc:729] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 21a5e6dc2695447798b4a87e7c6108db, State: Initialized, Role: LEARNER
I20240502 20:47:25.104259 31486 consensus_queue.cc:260] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } }
I20240502 20:47:25.104537 31486 ts_tablet_manager.cc:1398] T 50134092a82f42b08ffacf2eff58b0f9 P 21a5e6dc2695447798b4a87e7c6108db: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 20:47:25.105748 26777 tablet_copy_service.cc:342] P b4908484400a4ce2aea341e9e1bdced3: Request end of tablet copy session 21a5e6dc2695447798b4a87e7c6108db-50134092a82f42b08ffacf2eff58b0f9 received from {username='slave'} at 127.9.82.138:34787
I20240502 20:47:25.105829 26777 tablet_copy_service.cc:433] P b4908484400a4ce2aea341e9e1bdced3: ending tablet copy session 21a5e6dc2695447798b4a87e7c6108db-50134092a82f42b08ffacf2eff58b0f9 on tablet 50134092a82f42b08ffacf2eff58b0f9 with peer 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:25.125226 31492 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:25.125559 31492 tablet_bootstrap.cc:492] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Bootstrap complete.
I20240502 20:47:25.125738 31492 ts_tablet_manager.cc:1367] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent bootstrapping tablet: real 0.047s user 0.024s sys 0.004s
I20240502 20:47:25.126201 31492 raft_consensus.cc:348] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } }
I20240502 20:47:25.126353 31492 raft_consensus.cc:729] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9aaa16c4fc46478f90a3d97b010330c2, State: Initialized, Role: LEARNER
I20240502 20:47:25.126449 31492 consensus_queue.cc:260] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: NON_VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: true } }
I20240502 20:47:25.126817 31492 ts_tablet_manager.cc:1398] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:47:25.127436 26381 tablet_copy_service.cc:342] P bbee1301f7b94c6ab339ecaccc4ce740: Request end of tablet copy session 9aaa16c4fc46478f90a3d97b010330c2-406675832bd84f4ea6de10c0ae14ec53 received from {username='slave'} at 127.9.82.133:56461
I20240502 20:47:25.127525 26381 tablet_copy_service.cc:433] P bbee1301f7b94c6ab339ecaccc4ce740: ending tablet copy session 9aaa16c4fc46478f90a3d97b010330c2-406675832bd84f4ea6de10c0ae14ec53 on tablet 406675832bd84f4ea6de10c0ae14ec53 with peer 9aaa16c4fc46478f90a3d97b010330c2
I20240502 20:47:25.152910 31520 ts_tablet_manager.cc:902] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134:39815)
I20240502 20:47:25.153592 31520 tablet_copy_client.cc:308] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.134:39815
I20240502 20:47:25.154199 26645 tablet_copy_service.cc:140] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Received BeginTabletCopySession request for tablet 8659718d503141fa8a8024b700683858 from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:53893)
I20240502 20:47:25.154314 26645 tablet_copy_service.cc:161] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Beginning new tablet copy session on tablet 8659718d503141fa8a8024b700683858 from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:53893: session id = cc2b212930b84db1bb56f6952197955d-8659718d503141fa8a8024b700683858
I20240502 20:47:25.155246 26645 tablet_copy_source_session.cc:205] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:25.156237 31520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8659718d503141fa8a8024b700683858. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:25.158406 31520 tablet_copy_client.cc:783] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:25.158579 31520 tablet_copy_client.cc:647] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:25.159921 31520 tablet_copy_client.cc:523] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:25.161183 31520 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:25.187707 31556 ts_tablet_manager.cc:902] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: Initiating tablet copy from peer bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132:43125)
I20240502 20:47:25.188380 31556 tablet_copy_client.cc:308] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.132:43125
I20240502 20:47:25.189064 26381 tablet_copy_service.cc:140] P bbee1301f7b94c6ab339ecaccc4ce740: Received BeginTabletCopySession request for tablet e25072f604644d9595c95c1bd5bfd7db from peer cc2b212930b84db1bb56f6952197955d ({username='slave'} at 127.9.82.137:56675)
I20240502 20:47:25.189178 26381 tablet_copy_service.cc:161] P bbee1301f7b94c6ab339ecaccc4ce740: Beginning new tablet copy session on tablet e25072f604644d9595c95c1bd5bfd7db from peer cc2b212930b84db1bb56f6952197955d at {username='slave'} at 127.9.82.137:56675: session id = cc2b212930b84db1bb56f6952197955d-e25072f604644d9595c95c1bd5bfd7db
I20240502 20:47:25.189802 31520 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:25.190107 31520 tablet_bootstrap.cc:492] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:25.190241 26381 tablet_copy_source_session.cc:205] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:25.190307 31520 ts_tablet_manager.cc:1367] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.029s user 0.023s sys 0.005s
I20240502 20:47:25.190783 31520 raft_consensus.cc:348] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:25.190963 31520 raft_consensus.cc:729] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:25.191098 31520 consensus_queue.cc:260] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:25.191395 31520 ts_tablet_manager.cc:1398] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 20:47:25.191890 26645 tablet_copy_service.cc:342] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-8659718d503141fa8a8024b700683858 received from {username='slave'} at 127.9.82.137:53893
I20240502 20:47:25.191970 26645 tablet_copy_service.cc:433] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: ending tablet copy session cc2b212930b84db1bb56f6952197955d-8659718d503141fa8a8024b700683858 on tablet 8659718d503141fa8a8024b700683858 with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:25.191972 31556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e25072f604644d9595c95c1bd5bfd7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:25.195693 31556 tablet_copy_client.cc:783] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:25.195883 31556 tablet_copy_client.cc:647] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:25.196179 31561 ts_tablet_manager.cc:902] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Initiating tablet copy from peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:25.196887 31561 tablet_copy_client.cc:308] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:37495
I20240502 20:47:25.197149 31556 tablet_copy_client.cc:523] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:25.197629 26513 tablet_copy_service.cc:140] P 9aaa16c4fc46478f90a3d97b010330c2: Received BeginTabletCopySession request for tablet fe3671f95cd0488cbdf684011ad3d1e3 from peer bbee1301f7b94c6ab339ecaccc4ce740 ({username='slave'} at 127.9.82.132:36067)
I20240502 20:47:25.197755 26513 tablet_copy_service.cc:161] P 9aaa16c4fc46478f90a3d97b010330c2: Beginning new tablet copy session on tablet fe3671f95cd0488cbdf684011ad3d1e3 from peer bbee1301f7b94c6ab339ecaccc4ce740 at {username='slave'} at 127.9.82.132:36067: session id = bbee1301f7b94c6ab339ecaccc4ce740-fe3671f95cd0488cbdf684011ad3d1e3
I20240502 20:47:25.198709 26513 tablet_copy_source_session.cc:205] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:25.199771 31561 ts_tablet_manager.cc:1875] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 20:47:25.200441 31556 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: Bootstrap starting.
I20240502 20:47:25.202127 31561 ts_tablet_manager.cc:1888] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 20:47:25.202314 31561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3671f95cd0488cbdf684011ad3d1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:25.203541 31561 tablet_copy_client.cc:783] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:25.203820 31561 tablet_copy_client.cc:647] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:25.205389 31561 tablet_copy_client.cc:523] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:25.206947 31561 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:25.229916 31556 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:25.230262 31556 tablet_bootstrap.cc:492] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: Bootstrap complete.
I20240502 20:47:25.230451 31556 ts_tablet_manager.cc:1367] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: Time spent bootstrapping tablet: real 0.030s user 0.022s sys 0.004s
I20240502 20:47:25.230919 31556 raft_consensus.cc:348] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:25.231076 31556 raft_consensus.cc:729] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc2b212930b84db1bb56f6952197955d, State: Initialized, Role: LEARNER
I20240502 20:47:25.231189 31556 consensus_queue.cc:260] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: NON_VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: true } }
I20240502 20:47:25.231488 31556 ts_tablet_manager.cc:1398] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:25.232281 26381 tablet_copy_service.cc:342] P bbee1301f7b94c6ab339ecaccc4ce740: Request end of tablet copy session cc2b212930b84db1bb56f6952197955d-e25072f604644d9595c95c1bd5bfd7db received from {username='slave'} at 127.9.82.137:56675
I20240502 20:47:25.232378 26381 tablet_copy_service.cc:433] P bbee1301f7b94c6ab339ecaccc4ce740: ending tablet copy session cc2b212930b84db1bb56f6952197955d-e25072f604644d9595c95c1bd5bfd7db on tablet e25072f604644d9595c95c1bd5bfd7db with peer cc2b212930b84db1bb56f6952197955d
I20240502 20:47:25.236001 31561 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:25.236272 31561 tablet_bootstrap.cc:492] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap complete.
I20240502 20:47:25.236438 31561 ts_tablet_manager.cc:1367] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.030s user 0.030s sys 0.000s
I20240502 20:47:25.236804 31561 raft_consensus.cc:348] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } }
I20240502 20:47:25.236927 31561 raft_consensus.cc:729] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: LEARNER
I20240502 20:47:25.237025 31561 consensus_queue.cc:260] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } }
I20240502 20:47:25.237267 31561 ts_tablet_manager.cc:1398] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 20:47:25.237859 26513 tablet_copy_service.cc:342] P 9aaa16c4fc46478f90a3d97b010330c2: Request end of tablet copy session bbee1301f7b94c6ab339ecaccc4ce740-fe3671f95cd0488cbdf684011ad3d1e3 received from {username='slave'} at 127.9.82.132:36067
I20240502 20:47:25.237963 26513 tablet_copy_service.cc:433] P 9aaa16c4fc46478f90a3d97b010330c2: ending tablet copy session bbee1301f7b94c6ab339ecaccc4ce740-fe3671f95cd0488cbdf684011ad3d1e3 on tablet fe3671f95cd0488cbdf684011ad3d1e3 with peer bbee1301f7b94c6ab339ecaccc4ce740
I20240502 20:47:25.304427 31486 ts_tablet_manager.cc:902] T fe3671f95cd0488cbdf684011ad3d1e3 P 21a5e6dc2695447798b4a87e7c6108db: Initiating tablet copy from peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
F20240502 20:47:25.304632 31486 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-00bf11a3e1c24449bba6a09d4ab280b0.queue_time_us, tablet-download-pool-00bf11a3e1c24449bba6a09d4ab280b0.queue_time_us) (tablet-download-pool-00bf11a3e1c24449bba6a09d4ab280b0.run_cpu_time_us, tablet-download-pool-00bf11a3e1c24449bba6a09d4ab280b0.run_cpu_time_us) (tablet-download-pool-00bf11a3e1c24449bba6a09d4ab280b0.run_wall_time_us, tablet-download-pool-00bf11a3e1c24449bba6a09d4ab280b0.run_wall_time_us) (tablet-download-pool-1c4c0137c6aa4820b0f0a5cf001c56d1.queue_time_us, tablet-download-pool-1c4c0137c6aa4820b0f0a5cf001c56d1.queue_time_us) (tablet-download-pool-1c4c0137c6aa4820b0f0a5cf001c56d1.run_cpu_time_us, tablet-download-pool-1c4c0137c6aa4820b0f0a5cf001c56d1.run_cpu_time_us) (tablet-download-pool-1c4c0137c6aa4820b0f0a5cf001c56d1.run_wall_time_us, tablet-download-pool-1c4c0137c6aa4820b0f0a5cf001c56d1.run_wall_time_us) (tablet-download-pool-23d260f1c3be4dd1b18fc82af355c137.queue_time_us, tablet-download-pool-23d260f1c3be4dd1b18fc82af355c137.queue_time_us) (tablet-download-pool-23d260f1c3be4dd1b18fc82af355c137.run_cpu_time_us, tablet-download-pool-23d260f1c3be4dd1b18fc82af355c137.run_cpu_time_us) (tablet-download-pool-23d260f1c3be4dd1b18fc82af355c137.run_wall_time_us, tablet-download-pool-23d260f1c3be4dd1b18fc82af355c137.run_wall_time_us) (tablet-download-pool-406675832bd84f4ea6de10c0ae14ec53.queue_time_us, tablet-download-pool-406675832bd84f4ea6de10c0ae14ec53.queue_time_us) (tablet-download-pool-406675832bd84f4ea6de10c0ae14ec53.run_cpu_time_us, tablet-download-pool-406675832bd84f4ea6de10c0ae14ec53.run_cpu_time_us) (tablet-download-pool-406675832bd84f4ea6de10c0ae14ec53.run_wall_time_us, tablet-download-pool-406675832bd84f4ea6de10c0ae14ec53.run_wall_time_us) (tablet-download-pool-441da21c8ff8492c88c752ebf1233857.queue_time_us, tablet-download-pool-441da21c8ff8492c88c752ebf1233857.queue_time_us) (tablet-download-pool-441da21c8ff8492c88c752ebf1233857.run_cpu_time_us, tablet-download-pool-441da21c8ff8492c88c752ebf1233857.run_cpu_time_us) (tablet-download-pool-441da21c8ff8492c88c752ebf1233857.run_wall_time_us, tablet-download-pool-441da21c8ff8492c88c752ebf1233857.run_wall_time_us) (tablet-download-pool-50134092a82f42b08ffacf2eff58b0f9.queue_time_us, tablet-download-pool-50134092a82f42b08ffacf2eff58b0f9.queue_time_us) (tablet-download-pool-50134092a82f42b08ffacf2eff58b0f9.run_cpu_time_us, tablet-download-pool-50134092a82f42b08ffacf2eff58b0f9.run_cpu_time_us) (tablet-download-pool-50134092a82f42b08ffacf2eff58b0f9.run_wall_time_us, tablet-download-pool-50134092a82f42b08ffacf2eff58b0f9.run_wall_time_us) (tablet-download-pool-679352ffb9884583a0f1ee092d4badb1.queue_time_us, tablet-download-pool-679352ffb9884583a0f1ee092d4badb1.queue_time_us) (tablet-download-pool-679352ffb9884583a0f1ee092d4badb1.run_cpu_time_us, tablet-download-pool-679352ffb9884583a0f1ee092d4badb1.run_cpu_time_us) (tablet-download-pool-679352ffb9884583a0f1ee092d4badb1.run_wall_time_us, tablet-download-pool-679352ffb9884583a0f1ee092d4badb1.run_wall_time_us) (tablet-download-pool-8659718d503141fa8a8024b700683858.queue_time_us, tablet-download-pool-8659718d503141fa8a8024b700683858.queue_time_us) (tablet-download-pool-8659718d503141fa8a8024b700683858.run_cpu_time_us, tablet-download-pool-8659718d503141fa8a8024b700683858.run_cpu_time_us) (tablet-download-pool-8659718d503141fa8a8024b700683858.run_wall_time_us, tablet-download-pool-8659718d503141fa8a8024b700683858.run_wall_time_us) (tablet-download-pool-adb68aca646d42b2a869eaab1e3e805b.queue_time_us, tablet-download-pool-adb68aca646d42b2a869eaab1e3e805b.queue_time_us) (tablet-download-pool-adb68aca646d42b2a869eaab1e3e805b.run_cpu_time_us, tablet-download-pool-adb68aca646d42b2a869eaab1e3e805b.run_cpu_time_us) (tablet-download-pool-adb68aca646d42b2a869eaab1e3e805b.run_wall_time_us, tablet-download-pool-adb68aca646d42b2a869eaab1e3e805b.run_wall_time_us) (tablet-download-pool-bf4199a73df149368fb8d04f4c9723ef.queue_time_us, tablet-download-pool-bf4199a73df149368fb8d04f4c9723ef.queue_time_us) (tablet-download-pool-bf4199a73df149368fb8d04f4c9723ef.run_cpu_time_us, tablet-download-pool-bf4199a73df149368fb8d04f4c9723ef.run_cpu_time_us) (tablet-download-pool-bf4199a73df149368fb8d04f4c9723ef.run_wall_time_us, tablet-download-pool-bf4199a73df149368fb8d04f4c9723ef.run_wall_time_us) (tablet-download-pool-cacd9a8959094a24b6f7572e973ef71f.queue_time_us, tablet-download-pool-cacd9a8959094a24b6f7572e973ef71f.queue_time_us) (tablet-download-pool-cacd9a8959094a24b6f7572e973ef71f.run_cpu_time_us, tablet-download-pool-cacd9a8959094a24b6f7572e973ef71f.run_cpu_time_us) (tablet-download-pool-cacd9a8959094a24b6f7572e973ef71f.run_wall_time_us, tablet-download-pool-cacd9a8959094a24b6f7572e973ef71f.run_wall_time_us) (tablet-download-pool-e25072f604644d9595c95c1bd5bfd7db.queue_time_us, tablet-download-pool-e25072f604644d9595c95c1bd5bfd7db.queue_time_us) (tablet-download-pool-e25072f604644d9595c95c1bd5bfd7db.run_cpu_time_us, tablet-download-pool-e25072f604644d9595c95c1bd5bfd7db.run_cpu_time_us) (tablet-download-pool-e25072f604644d9595c95c1bd5bfd7db.run_wall_time_us, tablet-download-pool-e25072f604644d9595c95c1bd5bfd7db.run_wall_time_us) (tablet-download-pool-ec36083ee0ce441c9b2337a48d41a5fc.queue_time_us, tablet-download-pool-ec36083ee0ce441c9b2337a48d41a5fc.queue_time_us) (tablet-download-pool-ec36083ee0ce441c9b2337a48d41a5fc.run_cpu_time_us, tablet-download-pool-ec36083ee0ce441c9b2337a48d41a5fc.run_cpu_time_us) (tablet-download-pool-ec36083ee0ce441c9b2337a48d41a5fc.run_wall_time_us, tablet-download-pool-ec36083ee0ce441c9b2337a48d41a5fc.run_wall_time_us) (tablet-download-pool-f81a35dbe00342f89c4a42a3cfbbeacc.queue_time_us, tablet-download-pool-f81a35dbe00342f89c4a42a3cfbbeacc.queue_time_us) (tablet-download-pool-f81a35dbe00342f89c4a42a3cfbbeacc.run_cpu_time_us, tablet-download-pool-f81a35dbe00342f89c4a42a3cfbbeacc.run_cpu_time_us) (tablet-download-pool-f81a35dbe00342f89c4a42a3cfbbeacc.run_wall_time_us, tablet-download-pool-f81a35dbe00342f89c4a42a3cfbbeacc.run_wall_time_us) (tablet-download-pool-fe3671f95cd0488cbdf684011ad3d1e3.queue_time_us, tablet-download-pool-fe3671f95cd0488cbdf684011ad3d1e3.queue_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
@ 0x7f563bb91dcd google::LogMessage::Fail() at ??:0
@ 0x7f563bb95b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f563bb917cc google::LogMessage::Flush() at ??:0
@ 0x7f563bb92f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f563cffb044 kudu::TraceMetrics::InternName() at ??:0
@ 0x7f563cfdff98 kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7f563cfddefc kudu::ThreadPoolBuilder::Build() at ??:0
@ 0x7f563fb9077a kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
I20240502 20:47:25.328217 31561 ts_tablet_manager.cc:902] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Initiating tablet copy from peer 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129)
I20240502 20:47:25.328835 31561 tablet_copy_client.cc:308] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.129:37129
I20240502 20:47:25.329437 25985 tablet_copy_service.cc:140] P 3c6dc91a7df244ab82c1161799ba2ff3: Received BeginTabletCopySession request for tablet cacd9a8959094a24b6f7572e973ef71f from peer bbee1301f7b94c6ab339ecaccc4ce740 ({username='slave'} at 127.9.82.132:33833)
@ 0x7f563fb99a45 kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
I20240502 20:47:25.329567 25985 tablet_copy_service.cc:161] P 3c6dc91a7df244ab82c1161799ba2ff3: Beginning new tablet copy session on tablet cacd9a8959094a24b6f7572e973ef71f from peer bbee1301f7b94c6ab339ecaccc4ce740 at {username='slave'} at 127.9.82.132:33833: session id = bbee1301f7b94c6ab339ecaccc4ce740-cacd9a8959094a24b6f7572e973ef71f
I20240502 20:47:25.330854 25985 tablet_copy_source_session.cc:205] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:25.331957 31561 ts_tablet_manager.cc:1875] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_COPYING
@ 0x7f563fc1a76f kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7f563fc2e4f6 kudu::tserver::TabletCopyRunnable::Run() at ??:0
I20240502 20:47:25.337812 31561 ts_tablet_manager.cc:1888] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 20:47:25.338025 31561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cacd9a8959094a24b6f7572e973ef71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:25.339756 31561 tablet_copy_client.cc:783] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:25.339926 31561 tablet_copy_client.cc:647] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Starting download of 1 WAL segments...
@ 0x7f563fc19226 _ZZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS_6StatusENS0_24TabletServerErrorPB_CodeEEEENKUlvE_clEv at ??:0
I20240502 20:47:25.341272 31561 tablet_copy_client.cc:523] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:25.342531 31561 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
@ 0x7f563fc28c0a _ZNSt17_Function_handlerIFvvEZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS1_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS1_6StatusENS2_24TabletServerErrorPB_CodeEEEEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x557dba26b75c std::function<>::operator()() at ??:0
@ 0x7f563cfe2e06 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f563cfe36ef _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f563cfe503b _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x557dba26b75c std::function<>::operator()() at ??:0
@ 0x7f563cfd2807 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f563d8106db start_thread at ??:0
@ 0x7f563ad4871f clone at ??:0
I20240502 20:47:25.382278 31561 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:25.382596 31561 tablet_bootstrap.cc:492] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap complete.
I20240502 20:47:25.382810 31561 ts_tablet_manager.cc:1367] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.040s user 0.034s sys 0.000s
I20240502 20:47:25.383349 31561 raft_consensus.cc:348] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } }
I20240502 20:47:25.383505 31561 raft_consensus.cc:729] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: LEARNER
I20240502 20:47:25.383618 31561 consensus_queue.cc:260] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } }
I20240502 20:47:25.384537 31561 ts_tablet_manager.cc:1398] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 20:47:25.385123 25985 tablet_copy_service.cc:342] P 3c6dc91a7df244ab82c1161799ba2ff3: Request end of tablet copy session bbee1301f7b94c6ab339ecaccc4ce740-cacd9a8959094a24b6f7572e973ef71f received from {username='slave'} at 127.9.82.132:33833
I20240502 20:47:25.385216 25985 tablet_copy_service.cc:433] P 3c6dc91a7df244ab82c1161799ba2ff3: ending tablet copy session bbee1301f7b94c6ab339ecaccc4ce740-cacd9a8959094a24b6f7572e973ef71f on tablet cacd9a8959094a24b6f7572e973ef71f with peer bbee1301f7b94c6ab339ecaccc4ce740
I20240502 20:47:25.413794 31634 ts_tablet_manager.cc:902] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Initiating tablet copy from peer 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495)
I20240502 20:47:25.417809 31634 tablet_copy_client.cc:308] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.133:37495
I20240502 20:47:25.418602 26513 tablet_copy_service.cc:140] P 9aaa16c4fc46478f90a3d97b010330c2: Received BeginTabletCopySession request for tablet 51586991cf25422681e1f758f6b7c52d from peer 4855f9c9a7f64986b4a0eb21e1ef6f0a ({username='slave'} at 127.9.82.134:60509)
I20240502 20:47:25.418649 31561 ts_tablet_manager.cc:902] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Initiating tablet copy from peer 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:25.418704 26513 tablet_copy_service.cc:161] P 9aaa16c4fc46478f90a3d97b010330c2: Beginning new tablet copy session on tablet 51586991cf25422681e1f758f6b7c52d from peer 4855f9c9a7f64986b4a0eb21e1ef6f0a at {username='slave'} at 127.9.82.134:60509: session id = 4855f9c9a7f64986b4a0eb21e1ef6f0a-51586991cf25422681e1f758f6b7c52d
I20240502 20:47:25.419096 31561 tablet_copy_client.cc:308] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Beginning tablet copy session from remote peer at address 127.9.82.130:34445
I20240502 20:47:25.419806 26513 tablet_copy_source_session.cc:205] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:25.419885 26116 tablet_copy_service.cc:140] P 73a41df730ef429d84fe648df03a2701: Received BeginTabletCopySession request for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 from peer bbee1301f7b94c6ab339ecaccc4ce740 ({username='slave'} at 127.9.82.132:44891)
I20240502 20:47:25.419975 26116 tablet_copy_service.cc:161] P 73a41df730ef429d84fe648df03a2701: Beginning new tablet copy session on tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 from peer bbee1301f7b94c6ab339ecaccc4ce740 at {username='slave'} at 127.9.82.132:44891: session id = bbee1301f7b94c6ab339ecaccc4ce740-1c4c0137c6aa4820b0f0a5cf001c56d1
I20240502 20:47:25.420799 26116 tablet_copy_source_session.cc:205] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 20:47:25.421540 31561 ts_tablet_manager.cc:1875] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 20:47:25.424050 31561 ts_tablet_manager.cc:1888] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 20:47:25.424227 31561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c4c0137c6aa4820b0f0a5cf001c56d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:25.424196 31634 ts_tablet_manager.cc:1875] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 20:47:25.426509 31634 ts_tablet_manager.cc:1888] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 20:47:25.426688 31634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51586991cf25422681e1f758f6b7c52d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 20:47:25.430881 31634 tablet_copy_client.cc:783] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:25.431097 31634 tablet_copy_client.cc:647] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:25.432194 31561 tablet_copy_client.cc:783] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Starting download of 0 data blocks...
I20240502 20:47:25.432351 31561 tablet_copy_client.cc:647] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Starting download of 1 WAL segments...
I20240502 20:47:25.432735 31634 tablet_copy_client.cc:523] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:25.433817 31561 tablet_copy_client.cc:523] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 20:47:25.434960 31634 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap starting.
I20240502 20:47:25.435374 31561 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap starting.
I20240502 20:47:25.445930 26493 raft_consensus.cc:1203] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:25.473778 31561 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:25.474078 31561 tablet_bootstrap.cc:492] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Bootstrap complete.
I20240502 20:47:25.474278 31561 ts_tablet_manager.cc:1367] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent bootstrapping tablet: real 0.039s user 0.027s sys 0.000s
I20240502 20:47:25.474749 31561 raft_consensus.cc:348] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } }
I20240502 20:47:25.474887 31561 raft_consensus.cc:729] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bbee1301f7b94c6ab339ecaccc4ce740, State: Initialized, Role: LEARNER
I20240502 20:47:25.474988 31561 consensus_queue.cc:260] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: NON_VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: true } }
I20240502 20:47:25.479053 31561 ts_tablet_manager.cc:1398] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 20:47:25.479554 26116 tablet_copy_service.cc:342] P 73a41df730ef429d84fe648df03a2701: Request end of tablet copy session bbee1301f7b94c6ab339ecaccc4ce740-1c4c0137c6aa4820b0f0a5cf001c56d1 received from {username='slave'} at 127.9.82.132:44891
I20240502 20:47:25.479643 26116 tablet_copy_service.cc:433] P 73a41df730ef429d84fe648df03a2701: ending tablet copy session bbee1301f7b94c6ab339ecaccc4ce740-1c4c0137c6aa4820b0f0a5cf001c56d1 on tablet 1c4c0137c6aa4820b0f0a5cf001c56d1 with peer bbee1301f7b94c6ab339ecaccc4ce740
I20240502 20:47:25.485203 26229 raft_consensus.cc:1203] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20240502 20:47:25.488065 31634 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 20:47:25.488399 31634 tablet_bootstrap.cc:492] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Bootstrap complete.
I20240502 20:47:25.488608 31634 ts_tablet_manager.cc:1367] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent bootstrapping tablet: real 0.054s user 0.030s sys 0.000s
I20240502 20:47:25.489413 31634 raft_consensus.cc:348] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } }
I20240502 20:47:25.489579 31634 raft_consensus.cc:729] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Initialized, Role: LEARNER
I20240502 20:47:25.489727 31634 consensus_queue.cc:260] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: NON_VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: true } }
I20240502 20:47:25.490595 31634 ts_tablet_manager.cc:1398] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 20:47:25.491237 26513 tablet_copy_service.cc:342] P 9aaa16c4fc46478f90a3d97b010330c2: Request end of tablet copy session 4855f9c9a7f64986b4a0eb21e1ef6f0a-51586991cf25422681e1f758f6b7c52d received from {username='slave'} at 127.9.82.134:60509
I20240502 20:47:25.491324 26513 tablet_copy_service.cc:433] P 9aaa16c4fc46478f90a3d97b010330c2: ending tablet copy session 4855f9c9a7f64986b4a0eb21e1ef6f0a-51586991cf25422681e1f758f6b7c52d on tablet 51586991cf25422681e1f758f6b7c52d with peer 4855f9c9a7f64986b4a0eb21e1ef6f0a
I20240502 20:47:25.497687 25962 raft_consensus.cc:1203] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
W20240502 20:47:25.582247 26031 connection.cc:535] client connection to 127.9.82.138:38195 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240502 20:47:25.582370 25899 connection.cc:535] client connection to 127.9.82.138:38195 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240502 20:47:25.582474 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240502 20:47:25.582523 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240502 20:47:25.582732 26295 connection.cc:535] client connection to 127.9.82.138:38195 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240502 20:47:25.582859 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240502 20:47:25.582862 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.9.82.138:38195 (error 108)
W20240502 20:47:25.582981 26559 connection.cc:535] client connection to 127.9.82.138:38195 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240502 20:47:25.583086 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20240502 20:47:25.584244 26427 consensus_peers.cc:462] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:47:25.584661 31684 negotiation.cc:337] Failed RPC negotiation. Trace:
0502 20:47:25.583305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.9.82.138:38195 (local address 127.9.82.130:49241)
0502 20:47:25.583603 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0502 20:47:25.583676 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":59,"threads_started":1}
W20240502 20:47:25.584784 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:25.584779 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:25.585211 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:25.585418 26295 consensus_peers.cc:485] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:25.585489 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:25.588719 28276 raft_consensus.cc:1203] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
W20240502 20:47:25.596478 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:47:25.597352 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:25.608263 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
I20240502 20:47:25.630362 26359 raft_consensus.cc:1203] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.8->[1.9-1.9] Dedup: 1.9->[]
I20240502 20:47:25.642663 26095 raft_consensus.cc:1203] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
W20240502 20:47:25.644516 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:25.667280 26163 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:25.667639 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:25.697893 28276 raft_consensus.cc:1203] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
W20240502 20:47:25.752918 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:25.773097 26427 consensus_peers.cc:462] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Unable to start Tablet Copy on peer: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:47:25.835050 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:25.889794 26559 consensus_peers.cc:485] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:25.912034 26625 raft_consensus.cc:1203] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:25.914461 26359 raft_consensus.cc:1203] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
W20240502 20:47:25.932025 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:25.951637 31676 raft_consensus.cc:1050] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3: attempting to promote NON_VOTER 6173ed1979b94e509bf1c843a5183690 to VOTER
I20240502 20:47:25.952318 31676 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } }
I20240502 20:47:25.954535 28144 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:25.954535 28276 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:25.954576 26095 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:25.954931 31818 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:25.954999 25962 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:25.955118 31192 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:25.955430 31676 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:25.955799 31192 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:25.956099 26625 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:25.956565 26229 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 LEARNER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:25.956924 26359 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:25.957351 31192 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:25.957767 31192 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:25.959396 31675 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:25.960934 31819 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.961356 26625 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.961570 26359 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.963261 25962 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.964107 28276 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.964655 25822 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 11 to 12, 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.966403 28144 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.969122 31038 raft_consensus.cc:1050] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740: attempting to promote NON_VOTER 9aaa16c4fc46478f90a3d97b010330c2 to VOTER
I20240502 20:47:25.968995 26095 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.969699 31038 consensus_queue.cc:237] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false } }
I20240502 20:47:25.971240 26359 raft_consensus.cc:1203] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 20:47:25.972776 26625 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:25.972822 26095 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:25.973578 25962 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:25.973958 26229 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:25.974172 26491 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEARNER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:25.974581 31834 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20240502 20:47:25.975870 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:25.975965 31170 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:25.976215 31166 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:25.976380 31170 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:25.976696 26757 raft_consensus.cc:1261] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:25.977193 31038 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:25.977723 26229 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.985040 31835 consensus_queue.cc:1035] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:25.985977 26757 consensus_queue.cc:237] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } }
I20240502 20:47:25.987125 31835 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false } } }
I20240502 20:47:25.987974 28276 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:25.988380 28144 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:25.988785 25962 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:25.989070 26491 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false } } }
I20240502 20:47:25.989315 31676 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:25.989979 31676 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:25.990010 26228 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false } } }
I20240502 20:47:25.990499 25962 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false } } }
I20240502 20:47:25.991585 26624 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false } } }
I20240502 20:47:25.992281 31820 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:25.993358 25814 catalog_manager.cc:5484] T 406675832bd84f4ea6de10c0ae14ec53 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 8 to 9, 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false } } }
I20240502 20:47:25.993556 26757 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false } } }
I20240502 20:47:25.994776 26228 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:25.995483 26625 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:25.996328 26095 raft_consensus.cc:2932] T 406675832bd84f4ea6de10c0ae14ec53 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } attrs { promote: false } } }
I20240502 20:47:25.997246 26359 raft_consensus.cc:1261] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer b4908484400a4ce2aea341e9e1bdced3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:25.997694 31820 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.998849 31818 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:25.998966 28276 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:25.999953 26625 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:26.000905 25810 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:26.001317 31676 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:26.001652 31676 consensus_queue.cc:1035] T 51a63a79b0ee42aba9fc7bf8e8c7428e P b4908484400a4ce2aea341e9e1bdced3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:26.001596 25965 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:26.002959 25822 catalog_manager.cc:5484] T 51a63a79b0ee42aba9fc7bf8e8c7428e P cc2b212930b84db1bb56f6952197955d reported cstate change: config changed from index 12 to 13, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New cstate: current_term: 1 leader_uuid: "b4908484400a4ce2aea341e9e1bdced3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:26.003811 28144 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:26.003942 26359 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:26.006973 26228 raft_consensus.cc:2932] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 73a41df730ef429d84fe648df03a2701 (127.9.82.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { promote: false } } }
I20240502 20:47:26.007925 26077 tablet_service.cc:1514] Processing DeleteTablet for tablet 51a63a79b0ee42aba9fc7bf8e8c7428e with delete_type TABLET_DATA_TOMBSTONED (TS 73a41df730ef429d84fe648df03a2701 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38270
I20240502 20:47:26.008402 31845 tablet_replica.cc:330] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701: stopping tablet replica
I20240502 20:47:26.008538 31845 raft_consensus.cc:2229] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:26.008839 31845 raft_consensus.cc:2258] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:26.009562 31845 ts_tablet_manager.cc:1875] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:26.012344 31845 ts_tablet_manager.cc:1888] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20240502 20:47:26.012424 31845 log.cc:1196] T 51a63a79b0ee42aba9fc7bf8e8c7428e P 73a41df730ef429d84fe648df03a2701: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-1/wal/wals/51a63a79b0ee42aba9fc7bf8e8c7428e
I20240502 20:47:26.012912 25808 catalog_manager.cc:4830] TS 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445): tablet 51a63a79b0ee42aba9fc7bf8e8c7428e (table rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]) successfully deleted
I20240502 20:47:26.067404 31677 raft_consensus.cc:1050] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2: attempting to promote NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 to VOTER
I20240502 20:47:26.067967 31677 consensus_queue.cc:237] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } }
I20240502 20:47:26.070202 28276 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.070199 26757 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.070592 26095 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
W20240502 20:47:26.070794 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:26.070902 31248 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.070996 26625 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.071295 26359 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.071548 26228 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.071965 31875 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.072129 31248 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.072443 31873 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.072553 31875 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.072607 25962 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.072685 31248 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.073048 31248 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.076216 31873 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.076833 26625 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.076876 26228 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.077073 25962 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.080132 28276 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.080240 26359 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.080536 25814 catalog_manager.cc:5484] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 9 to 10, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:26.082409 26757 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.083127 26095 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.086608 26491 consensus_queue.cc:237] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } }
I20240502 20:47:26.089198 26095 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:26.089215 28276 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:26.089568 26624 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:26.089874 26359 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:26.089987 31247 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:26.090181 26228 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:26.090267 31247 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:26.090509 31247 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:26.090648 31873 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:26.090772 31248 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20240502 20:47:26.090898 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:26.096130 25962 raft_consensus.cc:1261] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 20:47:26.096714 31248 consensus_queue.cc:1035] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 20:47:26.096405 31873 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.097934 26095 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.098291 26624 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.099180 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet fe3671f95cd0488cbdf684011ad3d1e3 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:26.099380 26228 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.099496 28276 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.101116 25962 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.102000 31837 raft_consensus.cc:1050] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:26.102586 31837 consensus_queue.cc:237] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:26.103252 25814 catalog_manager.cc:5484] T fe3671f95cd0488cbdf684011ad3d1e3 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 10 to 11, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.105129 28275 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.105597 31836 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.107306 26229 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.107683 31836 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20240502 20:47:26.109112 26295 consensus_peers.cc:485] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:26.110178 25962 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.110401 26757 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.110450 26096 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.110553 31836 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.110855 31836 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.110952 26491 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.111992 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3671f95cd0488cbdf684011ad3d1e3 with delete_type TABLET_DATA_TOMBSTONED (TS b4908484400a4ce2aea341e9e1bdced3 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:35780
I20240502 20:47:26.113092 31837 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.116505 31837 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.119388 31836 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.119855 26493 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.120855 31875 raft_consensus.cc:1050] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2: attempting to promote NON_VOTER 3c6dc91a7df244ab82c1161799ba2ff3 to VOTER
I20240502 20:47:26.121455 31875 consensus_queue.cc:237] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false } }
I20240502 20:47:26.123987 26624 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.124444 26228 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.124691 28144 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.125362 26755 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.125483 25962 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEARNER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.125481 31876 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.125824 31873 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.126485 25814 catalog_manager.cc:5484] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.127245 31876 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.128448 26229 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.128690 31874 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.129666 28275 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.130774 31874 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20240502 20:47:26.130925 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:26.131662 25962 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.133520 26095 raft_consensus.cc:1261] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.133970 31856 raft_consensus.cc:1050] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a: attempting to promote NON_VOTER cc2b212930b84db1bb56f6952197955d to VOTER
I20240502 20:47:26.134512 31856 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:26.136907 26755 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.140149 25962 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.140475 28144 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.140898 31739 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.141259 31739 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.143119 26491 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.143540 26229 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.143884 26359 raft_consensus.cc:2932] T fe3671f95cd0488cbdf684011ad3d1e3 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false replace: true } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: NON_VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: true } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
W20240502 20:47:26.145113 26559 consensus_peers.cc:485] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:26.146414 31739 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.146564 28275 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d [term 1 LEARNER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.146844 31739 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.146970 31148 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.147290 31889 tablet_replica.cc:330] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3: stopping tablet replica
I20240502 20:47:26.147444 31889 raft_consensus.cc:2229] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:26.147785 31889 raft_consensus.cc:2258] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:26.148825 31889 ts_tablet_manager.cc:1875] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:26.150451 26755 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.150861 31739 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.152267 31874 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false } } }
I20240502 20:47:26.154860 26359 consensus_queue.cc:237] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:26.154820 25962 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false } } }
I20240502 20:47:26.156708 28144 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false } } }
I20240502 20:47:26.156755 26757 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false } } }
I20240502 20:47:26.158213 26624 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false } } }
I20240502 20:47:26.159225 26757 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.159660 31837 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.160326 26493 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.160410 25962 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.160835 26227 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.161326 25821 catalog_manager.cc:5484] T adb68aca646d42b2a869eaab1e3e805b P 706762b60f514a048c4935e359027441 reported cstate change: config changed from index 11 to 12, 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false } } }
I20240502 20:47:26.161788 31838 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.162083 31838 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.162283 31837 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.163625 28276 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.164052 31837 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.164880 26228 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false } } }
I20240502 20:47:26.166358 31837 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.166563 31905 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.166885 26757 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.169039 25962 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.170341 28144 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.170428 25965 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.170579 26229 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.172305 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e25072f604644d9595c95c1bd5bfd7db with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:26.172456 26757 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.173035 25818 catalog_manager.cc:5484] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 9 to 10, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New cstate: current_term: 1 leader_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:26.173025 26493 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.173466 28276 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.174996 25822 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 reported cstate change: config changed from index 11 to 12, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.179432 28275 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.181990 26491 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.183219 26096 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.184944 26094 raft_consensus.cc:1261] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer bbee1301f7b94c6ab339ecaccc4ce740: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.185341 31876 consensus_queue.cc:1035] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.186663 26228 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, cc2b212930b84db1bb56f6952197955d (127.9.82.137) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false replace: true } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.187690 26624 consensus_queue.cc:237] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } }
I20240502 20:47:26.190311 28275 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:26.190343 25965 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:26.190385 31285 raft_consensus.cc:1050] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: attempting to promote NON_VOTER 73a41df730ef429d84fe648df03a2701 to VOTER
I20240502 20:47:26.190750 31908 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:26.190956 31285 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } }
I20240502 20:47:26.191470 31889 ts_tablet_manager.cc:1888] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.10
I20240502 20:47:26.191550 31889 log.cc:1196] T fe3671f95cd0488cbdf684011ad3d1e3 P b4908484400a4ce2aea341e9e1bdced3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/wals/fe3671f95cd0488cbdf684011ad3d1e3
I20240502 20:47:26.192085 26228 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
W20240502 20:47:26.192905 25808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
I20240502 20:47:26.193607 26491 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:26.193904 25810 catalog_manager.cc:4830] TS b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673): tablet fe3671f95cd0488cbdf684011ad3d1e3 (table rebalance_test_table_6 [id=ba28996d62464124a04001f4b657d18d]) successfully deleted
I20240502 20:47:26.194063 31905 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20240502 20:47:26.194084 25808 catalog_manager.cc:4573] TS 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e25072f604644d9595c95c1bd5bfd7db: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
I20240502 20:47:26.194662 28275 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.194692 26757 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.195331 25965 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.195823 31285 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.196022 31296 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.196394 31296 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.196492 26757 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
W20240502 20:47:26.196704 26163 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:26.196703 31905 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:26.196877 31907 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:26.196872 26094 raft_consensus.cc:2932] T adb68aca646d42b2a869eaab1e3e805b P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { replace: true } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } attrs { promote: false } } }
I20240502 20:47:26.198307 31038 consensus_queue.cc:1035] T e25072f604644d9595c95c1bd5bfd7db P bbee1301f7b94c6ab339ecaccc4ce740 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.199142 28144 raft_consensus.cc:1261] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 20:47:26.199442 31907 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.199931 31148 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:26.200531 26096 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEARNER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.200910 31285 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.201615 26491 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.202616 26094 raft_consensus.cc:2932] T e25072f604644d9595c95c1bd5bfd7db P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.203045 31285 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.202893 28275 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.203074 26228 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.203861 25808 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8659718d503141fa8a8024b700683858 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:26.205016 25965 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.205255 31148 consensus_queue.cc:1035] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:26.205380 26491 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.205773 25819 catalog_manager.cc:5484] T 8659718d503141fa8a8024b700683858 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 12 to 13, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New cstate: current_term: 1 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:26.208335 28144 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.209003 26755 raft_consensus.cc:2932] T 8659718d503141fa8a8024b700683858 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } }
I20240502 20:47:26.216416 26624 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 6173ed1979b94e509bf1c843a5183690: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.217022 31285 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.217936 31285 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 73a41df730ef429d84fe648df03a2701 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } } }
I20240502 20:47:26.220407 26491 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 73a41df730ef429d84fe648df03a2701 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } } }
I20240502 20:47:26.220412 26096 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 73a41df730ef429d84fe648df03a2701 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } } }
I20240502 20:47:26.220580 26755 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 73a41df730ef429d84fe648df03a2701 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } } }
I20240502 20:47:26.222746 25965 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 73a41df730ef429d84fe648df03a2701 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } } }
I20240502 20:47:26.223964 25818 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 reported cstate change: config changed from index 11 to 12, 73a41df730ef429d84fe648df03a2701 (127.9.82.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6173ed1979b94e509bf1c843a5183690" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } } }
I20240502 20:47:26.225576 26624 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 73a41df730ef429d84fe648df03a2701 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } } }
I20240502 20:47:26.226116 28275 raft_consensus.cc:2932] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 73a41df730ef429d84fe648df03a2701 (127.9.82.130) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } } }
I20240502 20:47:26.277184 26228 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1"
dest_uuid: "6173ed1979b94e509bf1c843a5183690"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:54954
I20240502 20:47:26.277360 26228 raft_consensus.cc:595] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Received request to transfer leadership
I20240502 20:47:26.319510 31796 raft_consensus.cc:1050] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3: attempting to promote NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 to VOTER
I20240502 20:47:26.320081 31796 consensus_queue.cc:237] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } }
I20240502 20:47:26.322755 26757 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.322957 28144 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.323215 26624 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.323220 32021 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.323464 31884 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.323632 26491 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.323982 31884 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.324244 31884 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.324296 26359 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 20:47:26.324487 26096 raft_consensus.cc:1261] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 3c6dc91a7df244ab82c1161799ba2ff3: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
W20240502 20:47:26.325956 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:26.326149 32021 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.326685 32021 consensus_queue.cc:1035] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 20:47:26.328689 32021 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.329555 26359 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.331288 28144 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 706762b60f514a048c4935e359027441 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.331396 26624 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.333278 26096 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.333298 26757 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.333411 25821 catalog_manager.cc:5484] T cacd9a8959094a24b6f7572e973ef71f P bbee1301f7b94c6ab339ecaccc4ce740 reported cstate change: config changed from index 11 to 12, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.335425 26491 raft_consensus.cc:2932] T cacd9a8959094a24b6f7572e973ef71f P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "706762b60f514a048c4935e359027441" member_type: VOTER last_known_addr { host: "127.9.82.136" port: 41039 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.496001 26228 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1"
dest_uuid: "6173ed1979b94e509bf1c843a5183690"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:54968
I20240502 20:47:26.496136 26228 raft_consensus.cc:595] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Received request to transfer leadership
I20240502 20:47:26.526121 31874 raft_consensus.cc:1050] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2: attempting to promote NON_VOTER 4855f9c9a7f64986b4a0eb21e1ef6f0a to VOTER
I20240502 20:47:26.526772 31874 consensus_queue.cc:237] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } }
I20240502 20:47:26.529281 26096 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.529714 32078 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.536057 26625 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 LEARNER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.536609 31248 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.537827 25965 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.538149 26359 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.538646 31248 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.539678 26228 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.540125 31755 raft_consensus.cc:1050] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701: attempting to promote NON_VOTER bbee1301f7b94c6ab339ecaccc4ce740 to VOTER
I20240502 20:47:26.540551 31876 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.540627 26757 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.540709 31755 consensus_queue.cc:237] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } }
I20240502 20:47:26.541198 28275 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.541726 31875 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.542197 31677 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.544121 25963 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.546162 26361 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 LEARNER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.546253 26228 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.546837 26491 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
W20240502 20:47:26.547214 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 20:47:26.547251 32083 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.547372 32087 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.547418 26625 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.547556 26757 raft_consensus.cc:1261] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Refusing update from remote peer 73a41df730ef429d84fe648df03a2701: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 20:47:26.548796 31677 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.549594 32087 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.549942 31248 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.550632 26624 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.550760 32084 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.551753 31678 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.552274 26359 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.553755 25818 catalog_manager.cc:5484] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: config changed from index 8 to 9, 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.554553 32085 consensus_queue.cc:1035] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 20:47:26.555509 26096 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.555689 26757 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.557281 25963 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.558470 28275 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.562189 32085 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.562703 26229 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.562996 26757 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.565004 25963 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.566483 26491 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.568229 25815 catalog_manager.cc:5484] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 reported cstate change: config changed from index 8 to 9, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73a41df730ef429d84fe648df03a2701" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 20:47:26.569764 26624 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.570407 26229 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.574162 26359 raft_consensus.cc:2932] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, bbee1301f7b94c6ab339ecaccc4ce740 (127.9.82.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } attrs { replace: true } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } attrs { promote: false } } }
I20240502 20:47:26.577520 26491 consensus_queue.cc:237] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } }
I20240502 20:47:26.579285 28275 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.579434 26624 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.579478 26359 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.579546 26096 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.579782 25963 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.579838 26229 raft_consensus.cc:1261] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Refusing update from remote peer 9aaa16c4fc46478f90a3d97b010330c2: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 20:47:26.580008 31875 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.580194 31247 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.580304 32078 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.580446 31248 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.580808 32078 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.580981 31875 consensus_queue.cc:1035] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 20:47:26.582664 31875 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.583582 25963 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.583767 28275 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.584496 26096 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.584980 26624 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.586591 25809 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 51586991cf25422681e1f758f6b7c52d with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 20:47:26.586669 26229 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.587553 25822 catalog_manager.cc:5484] T 51586991cf25422681e1f758f6b7c52d P cc2b212930b84db1bb56f6952197955d reported cstate change: config changed from index 9 to 10, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New cstate: current_term: 1 leader_uuid: "9aaa16c4fc46478f90a3d97b010330c2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.588723 26359 raft_consensus.cc:2932] T 51586991cf25422681e1f758f6b7c52d P bbee1301f7b94c6ab339ecaccc4ce740 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "bbee1301f7b94c6ab339ecaccc4ce740" member_type: VOTER last_known_addr { host: "127.9.82.132" port: 43125 } } peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } attrs { promote: false } } }
I20240502 20:47:26.590410 26736 tablet_service.cc:1514] Processing DeleteTablet for tablet 51586991cf25422681e1f758f6b7c52d with delete_type TABLET_DATA_TOMBSTONED (TS b4908484400a4ce2aea341e9e1bdced3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:35780
I20240502 20:47:26.590663 31889 tablet_replica.cc:330] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3: stopping tablet replica
I20240502 20:47:26.590811 31889 raft_consensus.cc:2229] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 20:47:26.591081 31889 raft_consensus.cc:2258] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 20:47:26.591897 31889 ts_tablet_manager.cc:1875] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 20:47:26.593940 31889 ts_tablet_manager.cc:1888] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 20:47:26.594018 31889 log.cc:1196] T 51586991cf25422681e1f758f6b7c52d P b4908484400a4ce2aea341e9e1bdced3: Deleting WAL directory at /tmp/dist-test-taskIC8fEc/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714682725893869-9546-0/raft_consensus-itest-cluster/ts-6/wal/wals/51586991cf25422681e1f758f6b7c52d
I20240502 20:47:26.594543 25810 catalog_manager.cc:4830] TS b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673): tablet 51586991cf25422681e1f758f6b7c52d (table rebalance_test_table_3 [id=047a8e378c364707b4a780c073f4d9b3]) successfully deleted
I20240502 20:47:26.604080 31932 raft_consensus.cc:979] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690: : Instructing follower 4855f9c9a7f64986b4a0eb21e1ef6f0a to start an election
I20240502 20:47:26.604197 31932 raft_consensus.cc:1067] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Signalling peer 4855f9c9a7f64986b4a0eb21e1ef6f0a to start an election
I20240502 20:47:26.604794 26624 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1"
dest_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a"
from {username='slave'} at 127.9.82.131:58819
I20240502 20:47:26.604961 26624 raft_consensus.cc:482] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 20:47:26.605047 26624 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:47:26.606120 26624 raft_consensus.cc:504] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } }
I20240502 20:47:26.607033 25963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: true dest_uuid: "3c6dc91a7df244ab82c1161799ba2ff3"
I20240502 20:47:26.607223 25963 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:47:26.607604 28275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: true dest_uuid: "cc2b212930b84db1bb56f6952197955d"
I20240502 20:47:26.608078 26491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: true dest_uuid: "9aaa16c4fc46478f90a3d97b010330c2"
I20240502 20:47:26.608232 26491 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 1 FOLLOWER]: Advancing to term 2
W20240502 20:47:26.608229 26559 leader_election.cc:334] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
I20240502 20:47:26.608342 26624 leader_election.cc:288] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 2 election: Requested vote from peers 3c6dc91a7df244ab82c1161799ba2ff3 (127.9.82.129:37129), 6173ed1979b94e509bf1c843a5183690 (127.9.82.131:39463), 9aaa16c4fc46478f90a3d97b010330c2 (127.9.82.133:37495), b4908484400a4ce2aea341e9e1bdced3 (127.9.82.135:39673), cc2b212930b84db1bb56f6952197955d (127.9.82.137:35891), 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195), 73a41df730ef429d84fe648df03a2701 (127.9.82.130:34445)
I20240502 20:47:26.608636 25963 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 2.
I20240502 20:47:26.608668 26229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: true dest_uuid: "6173ed1979b94e509bf1c843a5183690"
I20240502 20:47:26.608814 26229 raft_consensus.cc:3032] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 20:47:26.608870 26229 raft_consensus.cc:729] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6173ed1979b94e509bf1c843a5183690, State: Running, Role: LEADER
I20240502 20:47:26.609097 28275 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:47:26.609064 26229 consensus_queue.cc:260] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } }
I20240502 20:47:26.609376 26229 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:47:26.610291 26229 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 2.
I20240502 20:47:26.610741 28275 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 2.
I20240502 20:47:26.611066 26096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: true dest_uuid: "73a41df730ef429d84fe648df03a2701"
I20240502 20:47:26.611229 26096 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:47:26.611248 26491 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 2.
I20240502 20:47:26.611740 26560 leader_election.cc:302] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 6 responses out of 8 voters: 5 yes votes; 1 no votes. yes voters: 3c6dc91a7df244ab82c1161799ba2ff3, 4855f9c9a7f64986b4a0eb21e1ef6f0a, 6173ed1979b94e509bf1c843a5183690, 9aaa16c4fc46478f90a3d97b010330c2, cc2b212930b84db1bb56f6952197955d; no voters: 21a5e6dc2695447798b4a87e7c6108db
I20240502 20:47:26.611930 31908 raft_consensus.cc:2781] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 2 FOLLOWER]: Leader election won for term 2
I20240502 20:47:26.612003 31908 raft_consensus.cc:686] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [term 2 LEADER]: Becoming Leader. State: Replica: 4855f9c9a7f64986b4a0eb21e1ef6f0a, State: Running, Role: LEADER
I20240502 20:47:26.612188 31908 consensus_queue.cc:237] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } }
I20240502 20:47:26.612358 26096 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 2.
I20240502 20:47:26.611877 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "679352ffb9884583a0f1ee092d4badb1" candidate_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: true dest_uuid: "b4908484400a4ce2aea341e9e1bdced3"
I20240502 20:47:26.612615 26757 raft_consensus.cc:3037] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 1 FOLLOWER]: Advancing to term 2
I20240502 20:47:26.613627 26757 raft_consensus.cc:2454] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4855f9c9a7f64986b4a0eb21e1ef6f0a in term 2.
I20240502 20:47:26.614717 25823 catalog_manager.cc:5484] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a reported cstate change: term changed from 1 to 2, leader changed from 6173ed1979b94e509bf1c843a5183690 (127.9.82.131) to 4855f9c9a7f64986b4a0eb21e1ef6f0a (127.9.82.134). New cstate: current_term: 2 leader_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4855f9c9a7f64986b4a0eb21e1ef6f0a" member_type: VOTER last_known_addr { host: "127.9.82.134" port: 39815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21a5e6dc2695447798b4a87e7c6108db" member_type: VOTER last_known_addr { host: "127.9.82.138" port: 38195 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 20:47:27.009897 28275 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P cc2b212930b84db1bb56f6952197955d [term 2 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20240502 20:47:27.010385 31904 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc2b212930b84db1bb56f6952197955d" member_type: VOTER last_known_addr { host: "127.9.82.137" port: 35891 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:27.087320 26491 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 9aaa16c4fc46478f90a3d97b010330c2 [term 2 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20240502 20:47:27.087777 31904 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aaa16c4fc46478f90a3d97b010330c2" member_type: VOTER last_known_addr { host: "127.9.82.133" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:27.105820 26757 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P b4908484400a4ce2aea341e9e1bdced3 [term 2 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20240502 20:47:27.106221 31904 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4908484400a4ce2aea341e9e1bdced3" member_type: VOTER last_known_addr { host: "127.9.82.135" port: 39673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:27.121636 26096 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 73a41df730ef429d84fe648df03a2701 [term 2 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20240502 20:47:27.122190 31904 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73a41df730ef429d84fe648df03a2701" member_type: VOTER last_known_addr { host: "127.9.82.130" port: 34445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:27.125124 26229 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 6173ed1979b94e509bf1c843a5183690 [term 2 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20240502 20:47:27.125919 25963 raft_consensus.cc:1261] T 679352ffb9884583a0f1ee092d4badb1 P 3c6dc91a7df244ab82c1161799ba2ff3 [term 2 FOLLOWER]: Refusing update from remote peer 4855f9c9a7f64986b4a0eb21e1ef6f0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20240502 20:47:27.126335 31904 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6173ed1979b94e509bf1c843a5183690" member_type: VOTER last_known_addr { host: "127.9.82.131" port: 39463 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 20:47:27.126600 31904 consensus_queue.cc:1035] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c6dc91a7df244ab82c1161799ba2ff3" member_type: VOTER last_known_addr { host: "127.9.82.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20240502 20:47:27.131122 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 20:47:27.392791 25808 catalog_manager.cc:4573] TS 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e25072f604644d9595c95c1bd5bfd7db: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:47:27.465813 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:27.851843 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:27.979632 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:28.132404 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:28.133220 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:28.274430 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:28.374321 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:28.428401 25808 catalog_manager.cc:4573] TS 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e25072f604644d9595c95c1bd5bfd7db: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:47:28.556457 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:28.646098 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:28.663128 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:28.904187 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:29.091981 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:29.577209 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20240502 20:47:30.019145 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:30.172776 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:30.230439 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:30.504946 25808 catalog_manager.cc:4573] TS 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e25072f604644d9595c95c1bd5bfd7db: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:47:30.571091 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:30.594835 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:47:30.601517 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:47:30.649892 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 21 similar messages]
W20240502 20:47:30.698510 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:47:30.699285 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:30.741536 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:30.772585 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 12 similar messages]
W20240502 20:47:30.792101 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:30.891076 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:30.972959 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:47:31.033279 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 13 similar messages]
W20240502 20:47:31.034148 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:31.125794 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:31.581791 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:31.653679 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:31.915853 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 20:47:32.532976 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:32.583009 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:32.669692 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:32.897869 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:33.234090 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:33.259073 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:33.307688 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:33.345839 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:33.397986 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:33.815115 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:34.046059 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:34.117386 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:34.246665 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20240502 20:47:34.628543 25808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 17 similar messages]
W20240502 20:47:34.629427 25808 catalog_manager.cc:4573] TS 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e25072f604644d9595c95c1bd5bfd7db: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:47:34.851109 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:35.062341 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:35.202549 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:35.295557 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:35.627290 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:47:35.640064 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:47:35.640797 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:35.759492 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:47:35.760326 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:35.861961 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:35.961522 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:36.087627 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:47:36.094936 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:47:36.143966 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:36.163362 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:47:36.185241 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:36.374243 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:36.380882 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:47:36.541396 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:36.626997 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20240502 20:47:37.127249 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:37.451783 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:37.605131 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:37.672621 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:38.076335 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:38.197106 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:38.272001 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:38.429975 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:38.644328 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:38.892375 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:39.116402 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:39.175315 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:39.183532 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20240502 20:47:39.612464 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:40.083561 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:40.108203 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:40.259296 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:40.579777 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:40.648845 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:47:40.734949 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:40.798031 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:47:40.798702 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:40.843580 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:47:40.844337 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:40.974397 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:41.032321 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:41.229308 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:47:41.308528 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:47:41.514991 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 21 similar messages]
W20240502 20:47:41.516371 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:41.579742 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:41.605722 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:47:41.740473 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20240502 20:47:42.263962 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:42.388190 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:42.672996 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:42.858727 25808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20240502 20:47:42.859494 25808 catalog_manager.cc:4573] TS 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e25072f604644d9595c95c1bd5bfd7db: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:47:43.063023 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:43.258883 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:43.353812 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:43.443810 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:43.615979 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:43.660332 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:43.701529 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:43.965466 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:44.173224 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:44.277788 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20240502 20:47:44.878927 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:44.942386 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:45.153771 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:45.441305 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:45.574546 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:45.713009 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:47:45.873313 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 28 similar messages]
W20240502 20:47:45.973805 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:47:45.974411 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:46.059482 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:46.069586 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:46.281286 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:46.331990 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:46.384537 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:46.486364 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:46.515903 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:47:46.544098 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:47:46.627753 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:47:46.671846 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20240502 20:47:47.031345 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:47:47.476398 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:47.523581 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:47.547205 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:47.874137 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:48.096504 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:48.448698 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:48.567951 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:48.629330 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:48.670374 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:48.747567 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:48.790767 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:48.913780 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:49.192297 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20240502 20:47:49.927515 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:50.002987 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:50.134828 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:50.401202 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:50.580228 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:50.858662 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:47:50.890954 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:47:50.966145 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:50.978490 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:47:51.006014 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:51.062764 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:51.231891 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:51.326709 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:51.387358 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:51.405431 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:51.495077 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20240502 20:47:51.574386 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20240502 20:47:51.605391 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:47:51.674940 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:47:52.146685 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:47:52.450243 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:52.542563 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:52.654644 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:53.139384 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:53.355159 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:53.371819 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:53.499351 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:53.567467 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:53.693964 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:53.748397 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:53.773662 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:53.898209 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:54.119067 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20240502 20:47:54.849983 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:54.905172 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:55.422230 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:55.517789 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:55.715333 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:55.781296 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:55.874979 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:55.974761 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:47:56.033032 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:56.045437 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:47:56.268196 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:56.318104 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:47:56.336277 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:56.472687 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:56.484431 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:56.501283 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20240502 20:47:56.676558 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:47:56.922327 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:47:56.979924 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:47:57.409000 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:47:57.409756 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:57.459136 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:57.790465 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:57.908625 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:58.255111 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:58.458690 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:58.466570 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:58.704397 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:58.899765 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:58.921131 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:59.015609 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:59.071602 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:59.139154 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20240502 20:47:59.262617 25808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20240502 20:47:59.263383 25808 catalog_manager.cc:4573] TS 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e25072f604644d9595c95c1bd5bfd7db: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:47:59.954370 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:00.200440 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:00.274597 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:00.471015 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:00.693509 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:00.894057 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:00.974050 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:01.063446 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:01.085518 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:48:01.086199 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:01.169279 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:01.252180 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:01.377648 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:01.419006 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:48:01.419831 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:01.613831 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20240502 20:48:01.938912 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:01.993256 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:02.021698 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:02.573252 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:02.617251 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:02.665378 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:02.666194 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:02.743880 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:02.926437 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:03.445108 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:03.517093 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:03.525758 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:03.597369 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:03.623010 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:03.826251 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:03.900661 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:03.954931 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20240502 20:48:04.993331 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:05.116714 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:05.184952 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:05.311018 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:05.447587 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:05.888654 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:05.989591 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:06.003120 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:06.014494 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:06.024106 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:06.100963 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:06.240459 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:06.361260 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:48:06.417271 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:06.429461 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:48:06.505844 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20240502 20:48:07.091790 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:07.152947 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 21 similar messages]
W20240502 20:48:07.190625 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:07.191444 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:07.520479 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:07.815937 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:07.885085 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:08.102380 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:08.103256 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:08.186666 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:08.339965 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:08.523556 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:08.558962 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:08.559329 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:08.657500 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:08.757397 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:08.870926 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 86: this message will repeat every 5th retry.
W20240502 20:48:09.759624 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:09.845202 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:10.221752 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:10.290604 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:10.561193 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:10.657400 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:10.957051 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:11.014573 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:11.034591 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:11.110453 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:11.128249 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:11.268641 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:11.343257 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 91: this message will repeat every 5th retry.
W20240502 20:48:11.450829 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:48:11.475955 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:11.644032 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:48:12.106254 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:12.228286 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:12.229121 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:12.290058 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:48:12.330978 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:12.609547 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:12.850486 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:12.962004 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:13.233651 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:13.312177 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:13.474422 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:13.491529 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:13.498111 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:13.515584 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:13.618129 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:13.759632 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:14.215543 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 96: this message will repeat every 5th retry.
W20240502 20:48:14.636602 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:14.795220 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:14.833767 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:15.157337 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:15.201056 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:15.541344 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:15.757417 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:15.822885 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:15.870672 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:15.959697 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:16.055300 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:16.077308 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:16.571461 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 32 similar messages]
W20240502 20:48:16.637948 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 21 similar messages]
W20240502 20:48:16.656498 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:48:16.657140 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 101: this message will repeat every 5th retry.
W20240502 20:48:17.138419 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:17.432834 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:17.433574 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:17.455291 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:17.462147 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:17.474395 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 22 similar messages]
W20240502 20:48:17.475103 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:17.722093 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:17.874970 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:18.265220 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:18.298029 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:18.315851 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:18.334581 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:18.425050 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:18.541853 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:18.811352 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:19.109174 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 106: this message will repeat every 5th retry.
W20240502 20:48:19.623634 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:19.747094 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:19.755764 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:19.946321 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:20.133576 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:20.369143 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:20.753837 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:20.756489 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:20.767007 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:20.769310 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:20.804919 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:20.809979 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:21.356016 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 111: this message will repeat every 5th retry.
W20240502 20:48:21.627823 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:48:21.740397 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:48:21.894421 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:22.035022 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:22.061177 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:22.247283 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:22.270886 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:22.572806 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:48:22.573614 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:22.663105 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:22.824158 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:22.930975 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:23.050269 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:23.215629 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:23.278419 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:23.306273 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:23.407907 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:23.485637 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:23.808792 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 116: this message will repeat every 5th retry.
W20240502 20:48:24.032374 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20240502 20:48:24.394249 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:24.472165 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:24.583994 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:24.747237 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:24.985637 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:25.373970 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:25.649441 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:25.802930 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:25.811092 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:25.861565 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:25.875370 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:26.051441 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:26.433444 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 121: this message will repeat every 5th retry.
W20240502 20:48:26.689352 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 28 similar messages]
W20240502 20:48:26.751124 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:26.757176 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:48:27.148640 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 21 similar messages]
W20240502 20:48:27.168426 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:27.187022 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:27.300323 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:27.344105 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:27.762912 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:27.921412 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:27.922408 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:28.035554 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:28.098919 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:28.240059 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:28.302892 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:28.303568 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:28.438410 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:28.443583 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:29.166797 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 126: this message will repeat every 5th retry.
W20240502 20:48:29.208031 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:29.422325 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:29.422950 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:29.713570 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:29.811022 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:29.839435 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:29.987001 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:30.438616 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:30.573714 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:30.610873 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:30.641829 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:30.643282 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:31.039716 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:31.639274 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 131: this message will repeat every 5th retry.
W20240502 20:48:31.703936 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:31.822777 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:48:31.901736 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:48:32.013841 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:32.062043 25808 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20240502 20:48:32.062865 25808 catalog_manager.cc:4573] TS 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e25072f604644d9595c95c1bd5bfd7db: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111)
W20240502 20:48:32.143628 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:32.172530 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:32.318195 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:32.351827 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:32.671118 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:32.805171 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:32.840539 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:32.896366 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:32.901868 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:33.018169 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:33.315093 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 22 similar messages]
W20240502 20:48:33.409255 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:33.410075 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:33.460712 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:33.931313 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 136: this message will repeat every 5th retry.
W20240502 20:48:34.335175 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:34.411376 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:34.610960 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:34.704468 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:34.921950 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:34.924875 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:35.203094 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:35.310150 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:35.345135 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:35.450212 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:35.545938 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:35.933089 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:35.967533 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:36.372931 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 141: this message will repeat every 5th retry.
W20240502 20:48:36.817459 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:36.901528 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:48:36.925410 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:48:37.072546 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:37.107851 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:37.287406 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:48:37.297173 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:37.563601 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:37.687992 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:37.717586 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:37.952986 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:37.986435 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:38.200181 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:38.293362 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:38.329922 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:38.371207 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:38.584868 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:48:38.804067 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:38.903534 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 146: this message will repeat every 5th retry.
W20240502 20:48:39.308032 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:39.577688 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:39.607517 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:39.650969 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:40.101523 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:40.103638 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:40.216185 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:40.302595 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:40.434630 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:40.459895 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:40.619753 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:41.015462 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:41.031965 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:41.298238 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 151: this message will repeat every 5th retry.
W20240502 20:48:41.609362 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:41.963200 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:48:41.964006 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:41.978246 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:48:42.064839 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:42.143069 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:42.221287 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:42.401082 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:42.561096 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:42.913144 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:42.976823 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:43.027827 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:43.267899 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:43.349180 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:43.435127 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:43.508574 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:43.650393 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 156: this message will repeat every 5th retry.
W20240502 20:48:43.732504 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:44.044757 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:44.271064 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:44.426028 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:44.489809 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:44.507308 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:44.622489 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:44.799886 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:45.334039 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:45.336098 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:45.463975 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:45.657910 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:45.684576 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:45.747598 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:46.023659 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:46.273697 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 161: this message will repeat every 5th retry.
W20240502 20:48:46.612491 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:46.878279 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:46.918090 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:47.017896 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:47.044313 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:48:47.045032 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:47.047638 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:47.314311 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:48:47.725044 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:47.845775 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:47.886188 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:48.158735 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:48.257616 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:48.268282 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:48.445082 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:48.530655 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:48.745187 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 166: this message will repeat every 5th retry.
W20240502 20:48:48.925150 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 21 similar messages]
W20240502 20:48:49.049008 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:49.217972 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:49.349622 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:49.399047 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:49.418947 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:49.439579 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:49.658200 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:50.430680 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:50.491955 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:50.496579 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:50.556711 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:50.768096 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:50.772591 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:51.093997 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:51.414016 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 171: this message will repeat every 5th retry.
W20240502 20:48:51.684705 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:51.807271 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:51.896492 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:52.018296 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:52.044714 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:52.293154 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:48:52.403589 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:52.429585 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:48:52.625265 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:52.992659 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:53.079967 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:48:53.109362 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:53.167218 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:53.379673 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:53.454043 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:53.900862 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:53.960062 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:48:54.005188 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:54.093492 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:54.151271 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 176: this message will repeat every 5th retry.
W20240502 20:48:54.336158 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:54.419642 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:54.488911 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:54.502818 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:54.842643 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:54.907101 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:55.483319 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:55.738188 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:55.801023 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:55.919384 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:55.943926 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:55.950310 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:48:56.442133 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:56.542578 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:56.621255 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 181: this message will repeat every 5th retry.
W20240502 20:48:56.971776 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:56.976589 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:57.132179 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:57.293247 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:57.497416 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:48:57.666355 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:57.875567 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 33 similar messages]
W20240502 20:48:58.010967 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:58.252214 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:48:58.258668 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:58.270524 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:58.422291 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:58.604609 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:58.973898 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 186: this message will repeat every 5th retry.
W20240502 20:48:59.035264 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:48:59.166230 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:48:59.220919 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 18 similar messages]
W20240502 20:48:59.272338 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:48:59.507308 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:48:59.656682 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:48:59.832713 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:48:59.849684 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:48:59.908331 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:49:00.107012 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:49:00.437062 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:49:00.827124 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:49:00.877827 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:49:00.895537 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:49:01.115752 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:49:01.426652 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:01.485028 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:49:01.713960 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 191: this message will repeat every 5th retry.
W20240502 20:49:01.756587 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
I20240502 20:49:01.776748 25812 maintenance_manager.cc:419] P 23f153714b3b457c938b02b40ddaa9f9: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033370
I20240502 20:49:01.799141 25811 maintenance_manager.cc:643] P 23f153714b3b457c938b02b40ddaa9f9: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.022s user 0.020s sys 0.000s Metrics: {"bytes_written":21138,"cfile_init":1,"dirs.queue_time_us":220,"dirs.run_cpu_time_us":188,"dirs.run_wall_time_us":1024,"drs_written":1,"lbm_read_time_us":82,"lbm_reads_lt_1ms":4,"lbm_write_time_us":678,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":31,"thread_start_us":185,"threads_started":2,"wal-append.queue_time_us":180}
I20240502 20:49:01.800135 25812 maintenance_manager.cc:419] P 23f153714b3b457c938b02b40ddaa9f9: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9847 bytes on disk
I20240502 20:49:01.801323 25811 maintenance_manager.cc:643] P 23f153714b3b457c938b02b40ddaa9f9: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
W20240502 20:49:01.876291 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:02.136456 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:02.349581 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:02.402146 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:02.460039 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:02.523583 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:02.576879 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20240502 20:49:02.999342 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:03.033970 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20240502 20:49:03.311830 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 19 similar messages]
W20240502 20:49:03.394796 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:03.399686 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:03.608880 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:03.630167 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:04.164160 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 196: this message will repeat every 5th retry.
W20240502 20:49:04.303164 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:04.306200 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:04.492956 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:49:04.522874 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20240502 20:49:04.523681 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:04.735342 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:04.901743 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:04.993531 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20240502 20:49:05.106650 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:05.163159 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:05.612984 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:05.935966 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:05.945607 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:06.156183 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20240502 20:49:06.199914 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:06.573302 26295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:49:06.574067 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20240502 20:49:06.623929 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 201: this message will repeat every 5th retry.
W20240502 20:49:06.731490 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20240502 20:49:06.745952 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20240502 20:49:07.141243 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20240502 20:49:07.335362 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20240502 20:49:07.590109 26031 consensus_peers.cc:485] T 1c4c0137c6aa4820b0f0a5cf001c56d1 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
W20240502 20:49:07.693815 26559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
W20240502 20:49:07.721261 26031 consensus_peers.cc:485] T 441da21c8ff8492c88c752ebf1233857 P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
I20240502 20:49:07.737568 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc): perf score=0.033364
I20240502 20:49:07.738423 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef): perf score=0.033365
I20240502 20:49:07.738487 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db): perf score=0.033371
I20240502 20:49:07.773134 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef): perf score=0.033379
I20240502 20:49:07.796619 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef): perf score=0.033384
I20240502 20:49:07.797679 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.059s user 0.028s sys 0.004s Metrics: {"bytes_written":6152,"cfile_init":1,"compiler_manager_pool.queue_time_us":14818,"dirs.queue_time_us":11095,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":999,"drs_written":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4,"lbm_write_time_us":578,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":302,"threads_started":3,"wal-append.queue_time_us":13391}
I20240502 20:49:07.799389 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db): 4840 bytes on disk
I20240502 20:49:07.800032 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20240502 20:49:07.800997 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef): perf score=0.033380
I20240502 20:49:07.807806 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc): perf score=0.033391
I20240502 20:49:07.839257 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.100s user 0.021s sys 0.008s Metrics: {"bytes_written":6062,"cfile_init":1,"compiler_manager_pool.queue_time_us":18238,"dirs.queue_time_us":9471,"dirs.run_cpu_time_us":184,"dirs.run_wall_time_us":8865,"drs_written":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4,"lbm_write_time_us":559,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":301,"threads_started":3,"wal-append.queue_time_us":52692}
I20240502 20:49:07.840981 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db): perf score=0.033392
I20240502 20:49:07.845670 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.044s user 0.019s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":181,"dirs.run_wall_time_us":1385,"drs_written":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4,"lbm_write_time_us":555,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":105,"threads_started":1,"wal-append.queue_time_us":191}
I20240502 20:49:07.846856 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef): 4586 bytes on disk
I20240502 20:49:07.847316 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4}
I20240502 20:49:07.859393 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db): perf score=0.033401
I20240502 20:49:07.873041 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.135s user 0.033s sys 0.002s Metrics: {"bytes_written":6144,"cfile_init":1,"compiler_manager_pool.queue_time_us":171,"dirs.queue_time_us":9504,"dirs.run_cpu_time_us":186,"dirs.run_wall_time_us":2631,"drs_written":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4,"lbm_write_time_us":587,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":328,"threads_started":3,"wal-append.queue_time_us":10664}
I20240502 20:49:07.875751 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db): perf score=0.033398
I20240502 20:49:07.909238 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.101s user 0.033s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"compiler_manager_pool.queue_time_us":4889,"dirs.queue_time_us":22237,"dirs.run_cpu_time_us":211,"dirs.run_wall_time_us":959,"drs_written":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4,"lbm_write_time_us":595,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":321,"threads_started":3,"wal-append.queue_time_us":7558}
I20240502 20:49:07.910910 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db): perf score=0.033418
I20240502 20:49:07.931689 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.090s user 0.015s sys 0.005s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":8645,"dirs.run_cpu_time_us":174,"dirs.run_wall_time_us":1130,"drs_written":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4,"lbm_write_time_us":591,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":1247,"threads_started":1,"wal-append.queue_time_us":41124}
I20240502 20:49:07.933056 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db): 4840 bytes on disk
I20240502 20:49:07.933759 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4}
I20240502 20:49:07.934715 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef): 4586 bytes on disk
I20240502 20:49:07.935160 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20240502 20:49:07.972420 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.092s user 0.018s sys 0.003s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":182,"dirs.run_wall_time_us":1251,"drs_written":1,"lbm_read_time_us":125,"lbm_reads_lt_1ms":4,"lbm_write_time_us":635,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":100,"threads_started":1,"wal-append.queue_time_us":3237}
I20240502 20:49:07.973625 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc): 4925 bytes on disk
I20240502 20:49:07.974293 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4}
I20240502 20:49:07.975364 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db): 4840 bytes on disk
I20240502 20:49:07.975749 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.010401 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.099s user 0.016s sys 0.004s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":167,"dirs.run_wall_time_us":1195,"drs_written":1,"lbm_read_time_us":101,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6946,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":676,"thread_start_us":94,"threads_started":1,"wal-append.queue_time_us":10693}
I20240502 20:49:08.013011 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef): perf score=0.033445
I20240502 20:49:08.014014 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.217s user 0.029s sys 0.004s Metrics: {"bytes_written":6062,"cfile_init":1,"compiler_manager_pool.queue_time_us":33797,"dirs.queue_time_us":9861,"dirs.run_cpu_time_us":168,"dirs.run_wall_time_us":1226,"drs_written":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4,"lbm_write_time_us":585,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":292,"threads_started":3,"wal-append.queue_time_us":19257}
I20240502 20:49:08.015758 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef): 4586 bytes on disk
I20240502 20:49:08.022116 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.023260 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc): perf score=0.033443
I20240502 20:49:08.023312 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.250s user 0.032s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"compiler_manager_pool.queue_time_us":53293,"dirs.queue_time_us":176,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":10527,"drs_written":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4,"lbm_write_time_us":15729,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":635,"thread_start_us":293,"threads_started":3,"wal-append.queue_time_us":17502}
I20240502 20:49:08.025162 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef): 4586 bytes on disk
I20240502 20:49:08.026006 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.032410 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc): perf score=0.033448
W20240502 20:49:08.042696 26031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 29 similar messages]
I20240502 20:49:08.084756 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.225s user 0.026s sys 0.007s Metrics: {"bytes_written":6152,"cfile_init":1,"compiler_manager_pool.queue_time_us":43142,"dirs.queue_time_us":26237,"dirs.run_cpu_time_us":220,"dirs.run_wall_time_us":4790,"drs_written":1,"lbm_read_time_us":77,"lbm_reads_lt_1ms":4,"lbm_write_time_us":535,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":323,"threads_started":3,"wal-append.queue_time_us":38653}
I20240502 20:49:08.086338 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc): perf score=0.033462
I20240502 20:49:08.092320 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.078s user 0.018s sys 0.001s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":163,"dirs.run_wall_time_us":1420,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1841,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":635,"thread_start_us":121,"threads_started":1,"wal-append.queue_time_us":2866}
I20240502 20:49:08.093490 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc): 4925 bytes on disk
I20240502 20:49:08.094307 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":129,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.095309 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db): 4840 bytes on disk
I20240502 20:49:08.095762 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.096593 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef): 4586 bytes on disk
I20240502 20:49:08.096967 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(bf4199a73df149368fb8d04f4c9723ef) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.112892 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.080s user 0.021s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":1793,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":1083,"drs_written":1,"lbm_read_time_us":1374,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":1498,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":113,"threads_started":1,"wal-append.queue_time_us":17316}
I20240502 20:49:08.114127 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc): 4925 bytes on disk
I20240502 20:49:08.114538 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.133103 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.047s user 0.019s sys 0.001s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":2328,"dirs.run_cpu_time_us":168,"dirs.run_wall_time_us":1425,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":603,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":122,"threads_started":1,"wal-append.queue_time_us":12340}
I20240502 20:49:08.134097 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc): 4925 bytes on disk
I20240502 20:49:08.134742 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.135625 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db): 4840 bytes on disk
I20240502 20:49:08.136025 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.149245 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.126s user 0.021s sys 0.001s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":4151,"dirs.run_cpu_time_us":208,"dirs.run_wall_time_us":1223,"drs_written":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1619,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":689,"thread_start_us":125,"threads_started":1,"wal-append.queue_time_us":23079}
I20240502 20:49:08.150534 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc): 4925 bytes on disk
I20240502 20:49:08.151024 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(f81a35dbe00342f89c4a42a3cfbbeacc) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.151942 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db): perf score=0.033475
W20240502 20:49:08.183780 26691 consensus_peers.cc:485] T 50134092a82f42b08ffacf2eff58b0f9 P b4908484400a4ce2aea341e9e1bdced3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Error code: TABLET_NOT_FOUND (6). Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
I20240502 20:49:08.187055 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc): perf score=0.033336
I20240502 20:49:08.227651 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc): perf score=0.033343
I20240502 20:49:08.234935 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.083s user 0.019s sys 0.001s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":159,"dirs.run_wall_time_us":1384,"drs_written":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4,"lbm_write_time_us":598,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":106,"threads_started":1,"wal-append.queue_time_us":38397}
I20240502 20:49:08.236222 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(8659718d503141fa8a8024b700683858): perf score=0.033351
I20240502 20:49:08.265538 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.038s user 0.018s sys 0.001s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":172,"dirs.run_wall_time_us":1248,"drs_written":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4,"lbm_write_time_us":612,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":125,"threads_started":1,"wal-append.queue_time_us":7076}
I20240502 20:49:08.266729 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc): 4586 bytes on disk
I20240502 20:49:08.267148 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.268208 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1): perf score=0.033353
I20240502 20:49:08.273756 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.086s user 0.018s sys 0.003s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":167,"dirs.run_wall_time_us":1487,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":16814,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":635,"thread_start_us":87,"threads_started":1,"wal-append.queue_time_us":26212}
I20240502 20:49:08.274905 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc): 4586 bytes on disk
I20240502 20:49:08.275316 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.276309 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(8659718d503141fa8a8024b700683858): perf score=0.033358
W20240502 20:49:08.291538 26559 consensus_peers.cc:485] T 23d260f1c3be4dd1b18fc82af355c137 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
I20240502 20:49:08.325682 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.057s user 0.020s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":188,"dirs.run_wall_time_us":1288,"drs_written":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4,"lbm_write_time_us":617,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"spinlock_wait_cycles":2816,"thread_start_us":87,"threads_started":1,"wal-append.queue_time_us":11493}
I20240502 20:49:08.326882 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1): 4840 bytes on disk
I20240502 20:49:08.327322 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.335536 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.099s user 0.020s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":136,"dirs.run_wall_time_us":2020,"drs_written":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4,"lbm_write_time_us":663,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":98,"threads_started":1,"wal-append.queue_time_us":60003}
I20240502 20:49:08.336589 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858): 4925 bytes on disk
I20240502 20:49:08.337129 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.338018 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1): perf score=0.033375
I20240502 20:49:08.348824 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc): perf score=0.033381
I20240502 20:49:08.354079 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(8659718d503141fa8a8024b700683858): perf score=0.033384
I20240502 20:49:08.366338 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(8659718d503141fa8a8024b700683858): perf score=0.033387
I20240502 20:49:08.388036 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc): perf score=0.033390
I20240502 20:49:08.416762 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.140s user 0.022s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":1196,"drs_written":1,"lbm_read_time_us":92,"lbm_reads_lt_1ms":4,"lbm_write_time_us":538,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":100,"threads_started":1,"wal-append.queue_time_us":62330}
I20240502 20:49:08.417922 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1): perf score=0.033396
I20240502 20:49:08.422009 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.068s user 0.018s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":24302,"dirs.run_cpu_time_us":153,"dirs.run_wall_time_us":3341,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":571,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":199,"threads_started":2,"wal-append.queue_time_us":5955}
I20240502 20:49:08.424021 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc): perf score=0.033402
I20240502 20:49:08.429489 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.063s user 0.020s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":5298,"dirs.run_cpu_time_us":130,"dirs.run_wall_time_us":4465,"drs_written":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4,"lbm_write_time_us":621,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":123,"threads_started":1,"wal-append.queue_time_us":9871}
I20240502 20:49:08.430619 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858): 4925 bytes on disk
I20240502 20:49:08.431052 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.432420 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.083s user 0.017s sys 0.001s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":7378,"dirs.run_cpu_time_us":176,"dirs.run_wall_time_us":1318,"drs_written":1,"lbm_read_time_us":80,"lbm_reads_lt_1ms":4,"lbm_write_time_us":631,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":86,"threads_started":1,"wal-append.queue_time_us":27814}
I20240502 20:49:08.433426 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(8659718d503141fa8a8024b700683858): perf score=0.033401
I20240502 20:49:08.434260 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1): perf score=0.033400
I20240502 20:49:08.441329 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.053s user 0.018s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":135,"dirs.run_wall_time_us":943,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":584,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":113,"threads_started":1,"wal-append.queue_time_us":24056}
I20240502 20:49:08.442360 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc): 4586 bytes on disk
I20240502 20:49:08.442775 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.465631 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.127s user 0.019s sys 0.001s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":8816,"dirs.run_cpu_time_us":145,"dirs.run_wall_time_us":1251,"drs_written":1,"lbm_read_time_us":701,"lbm_reads_lt_1ms":4,"lbm_write_time_us":528,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":114,"threads_started":1,"wal-append.queue_time_us":28691}
I20240502 20:49:08.466799 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1): 4840 bytes on disk
I20240502 20:49:08.467381 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":92,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.468447 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db): 4840 bytes on disk
I20240502 20:49:08.468838 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(e25072f604644d9595c95c1bd5bfd7db) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.470135 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.044s user 0.015s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":45,"dirs.run_cpu_time_us":160,"dirs.run_wall_time_us":1239,"drs_written":1,"lbm_read_time_us":137,"lbm_reads_lt_1ms":4,"lbm_write_time_us":570,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":117,"threads_started":1,"wal-append.queue_time_us":2940}
I20240502 20:49:08.471235 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1): perf score=0.033412
I20240502 20:49:08.472651 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.038s user 0.016s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":5649,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":1010,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":578,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":71,"threads_started":1,"wal-append.queue_time_us":2522}
I20240502 20:49:08.473811 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858): 4925 bytes on disk
I20240502 20:49:08.474232 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.475088 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc): 4586 bytes on disk
I20240502 20:49:08.476033 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.042s user 0.020s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":9232,"dirs.run_cpu_time_us":162,"dirs.run_wall_time_us":3633,"drs_written":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4,"lbm_write_time_us":551,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":107,"threads_started":1,"wal-append.queue_time_us":5528}
I20240502 20:49:08.476555 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.477054 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1): 4840 bytes on disk
I20240502 20:49:08.477437 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.477816 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1): perf score=0.033412
I20240502 20:49:08.494738 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.077s user 0.020s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"compiler_manager_pool.queue_time_us":109027,"compiler_manager_pool.run_cpu_time_us":29,"compiler_manager_pool.run_wall_time_us":30,"dirs.queue_time_us":40,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":1112,"drs_written":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4,"lbm_write_time_us":575,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":107,"threads_started":1,"wal-append.queue_time_us":16861}
I20240502 20:49:08.496105 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858): 4925 bytes on disk
I20240502 20:49:08.496598 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.497606 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1): 4840 bytes on disk
I20240502 20:49:08.497983 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.510094 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.039s user 0.017s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":1441,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":651,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":104,"threads_started":1,"wal-append.queue_time_us":179}
I20240502 20:49:08.511413 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858): 4925 bytes on disk
I20240502 20:49:08.512077 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(8659718d503141fa8a8024b700683858) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.513053 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1): 4840 bytes on disk
I20240502 20:49:08.513509 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":65,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.514391 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc): 4586 bytes on disk
I20240502 20:49:08.514806 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(ec36083ee0ce441c9b2337a48d41a5fc) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.542793 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.065s user 0.018s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":1475,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":624,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":102,"threads_started":1,"wal-append.queue_time_us":32692}
I20240502 20:49:08.543926 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1): 4840 bytes on disk
I20240502 20:49:08.545820 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(1c4c0137c6aa4820b0f0a5cf001c56d1) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4}
W20240502 20:49:08.623467 26031 consensus_peers.cc:485] T ec36083ee0ce441c9b2337a48d41a5fc P 73a41df730ef429d84fe648df03a2701 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20240502 20:49:08.718782 25899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:49:08.719499 25899 consensus_peers.cc:485] T cacd9a8959094a24b6f7572e973ef71f P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
I20240502 20:49:08.729432 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37): perf score=0.033336
I20240502 20:49:08.742388 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.013s user 0.011s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":1355,"drs_written":1,"lbm_read_time_us":34,"lbm_reads_lt_1ms":4,"lbm_write_time_us":491,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":105,"threads_started":1,"wal-append.queue_time_us":225}
I20240502 20:49:08.743232 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37): 4925 bytes on disk
I20240502 20:49:08.743573 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.744258 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f): perf score=0.033339
I20240502 20:49:08.757025 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.013s user 0.006s sys 0.004s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":1396,"drs_written":1,"lbm_read_time_us":39,"lbm_reads_lt_1ms":4,"lbm_write_time_us":456,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":114,"threads_started":1,"wal-append.queue_time_us":313}
I20240502 20:49:08.758085 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b): perf score=0.033335
I20240502 20:49:08.766614 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37): perf score=0.033336
I20240502 20:49:08.783381 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.017s user 0.015s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":147,"dirs.run_wall_time_us":1236,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":579,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":87,"threads_started":1,"wal-append.queue_time_us":149}
I20240502 20:49:08.783460 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.025s user 0.015s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":139,"dirs.run_wall_time_us":1206,"drs_written":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4,"lbm_write_time_us":587,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":64,"threads_started":1,"wal-append.queue_time_us":5776}
I20240502 20:49:08.784302 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f): perf score=0.033336
I20240502 20:49:08.784351 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b): 4840 bytes on disk
I20240502 20:49:08.784701 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.785357 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f): 4584 bytes on disk
I20240502 20:49:08.785657 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":44,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.797590 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f): perf score=0.033350
I20240502 20:49:08.802007 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.017s user 0.013s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":33,"dirs.run_cpu_time_us":164,"dirs.run_wall_time_us":1222,"drs_written":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4,"lbm_write_time_us":448,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":57,"threads_started":1,"wal-append.queue_time_us":3009}
I20240502 20:49:08.803097 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b): perf score=0.033340
I20240502 20:49:08.814550 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.017s user 0.012s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":49,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":1229,"drs_written":1,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":445,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":100,"threads_started":1,"wal-append.queue_time_us":176}
I20240502 20:49:08.815531 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b): perf score=0.033354
I20240502 20:49:08.820072 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.017s user 0.010s sys 0.004s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":167,"dirs.run_wall_time_us":1009,"drs_written":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4,"lbm_write_time_us":792,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":135,"threads_started":1,"wal-append.queue_time_us":672}
I20240502 20:49:08.821035 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37): 4925 bytes on disk
I20240502 20:49:08.821334 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":43,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.821978 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b): 4840 bytes on disk
I20240502 20:49:08.822232 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":37,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.822826 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f): 4584 bytes on disk
I20240502 20:49:08.823081 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":43,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.829679 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37): perf score=0.033356
I20240502 20:49:08.829770 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.014s user 0.013s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":152,"dirs.run_cpu_time_us":189,"dirs.run_wall_time_us":1116,"drs_written":1,"lbm_read_time_us":35,"lbm_reads_lt_1ms":4,"lbm_write_time_us":514,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":77,"threads_started":1,"wal-append.queue_time_us":153}
I20240502 20:49:08.830698 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b): 4840 bytes on disk
I20240502 20:49:08.831069 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.831939 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f): 4584 bytes on disk
I20240502 20:49:08.832237 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":44,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.843183 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.013s user 0.010s sys 0.002s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":145,"dirs.run_cpu_time_us":194,"dirs.run_wall_time_us":1238,"drs_written":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4,"lbm_write_time_us":447,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":138,"threads_started":2,"wal-append.queue_time_us":137}
I20240502 20:49:08.844105 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f): perf score=0.033357
I20240502 20:49:08.857139 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.013s user 0.011s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":181,"dirs.run_wall_time_us":1349,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":458,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"spinlock_wait_cycles":83200,"thread_start_us":107,"threads_started":1,"wal-append.queue_time_us":186}
I20240502 20:49:08.857996 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37): 4925 bytes on disk
I20240502 20:49:08.858341 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.859145 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b): perf score=0.033360
W20240502 20:49:08.860273 26427 consensus_peers.cc:485] T adb68aca646d42b2a869eaab1e3e805b P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
I20240502 20:49:08.871590 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":133,"dirs.run_wall_time_us":1267,"drs_written":1,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":519,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":66,"threads_started":1,"wal-append.queue_time_us":161}
I20240502 20:49:08.872494 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b): 4840 bytes on disk
I20240502 20:49:08.872800 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.873565 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f): 4584 bytes on disk
I20240502 20:49:08.873868 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.944866 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37): perf score=0.033392
I20240502 20:49:08.958493 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.013s user 0.012s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":212,"dirs.run_cpu_time_us":192,"dirs.run_wall_time_us":1203,"drs_written":1,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":522,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":146,"threads_started":2,"wal-append.queue_time_us":149}
I20240502 20:49:08.959347 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37): 4925 bytes on disk
W20240502 20:49:08.959424 26295 consensus_peers.cc:485] T 406675832bd84f4ea6de10c0ae14ec53 P bbee1301f7b94c6ab339ecaccc4ce740 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
I20240502 20:49:08.959748 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4}
I20240502 20:49:08.971125 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f): perf score=0.033388
I20240502 20:49:08.986166 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.015s user 0.013s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":182,"dirs.run_cpu_time_us":237,"dirs.run_wall_time_us":1217,"drs_written":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4,"lbm_write_time_us":497,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":139,"threads_started":2,"wal-append.queue_time_us":130}
I20240502 20:49:08.987392 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f): 4584 bytes on disk
I20240502 20:49:08.988039 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(cacd9a8959094a24b6f7572e973ef71f) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.000531 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37): perf score=0.033403
I20240502 20:49:09.012137 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.011s user 0.010s sys 0.001s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":156,"dirs.run_cpu_time_us":178,"dirs.run_wall_time_us":1242,"drs_written":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4,"lbm_write_time_us":420,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":126,"threads_started":2,"wal-append.queue_time_us":124}
I20240502 20:49:09.013222 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b): perf score=0.033402
I20240502 20:49:09.024734 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.011s user 0.008s sys 0.002s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":146,"dirs.run_wall_time_us":1294,"drs_written":1,"lbm_read_time_us":34,"lbm_reads_lt_1ms":4,"lbm_write_time_us":362,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":65,"threads_started":1,"wal-append.queue_time_us":155}
I20240502 20:49:09.025694 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37): 4925 bytes on disk
I20240502 20:49:09.026080 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(d8efe0d8a46e47a59900e07e6430cd37) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.026814 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b): 4840 bytes on disk
I20240502 20:49:09.027124 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(adb68aca646d42b2a869eaab1e3e805b) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4}
W20240502 20:49:09.136925 26163 consensus_peers.cc:485] T 00bf11a3e1c24449bba6a09d4ab280b0 P 6173ed1979b94e509bf1c843a5183690 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20240502 20:49:09.269328 25899 consensus_peers.cc:485] T bf4199a73df149368fb8d04f4c9723ef P 3c6dc91a7df244ab82c1161799ba2ff3 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20240502 20:49:09.306136 26559 consensus_peers.cc:485] T 679352ffb9884583a0f1ee092d4badb1 P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 206: this message will repeat every 5th retry.
I20240502 20:49:09.325441 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9): perf score=0.033344
I20240502 20:49:09.334493 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9): perf score=0.033347
I20240502 20:49:09.346967 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.021s user 0.009s sys 0.002s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":145,"dirs.run_cpu_time_us":186,"dirs.run_wall_time_us":1490,"drs_written":1,"lbm_read_time_us":42,"lbm_reads_lt_1ms":4,"lbm_write_time_us":526,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":128,"threads_started":2,"wal-append.queue_time_us":8714}
I20240502 20:49:09.348088 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9): 4925 bytes on disk
I20240502 20:49:09.348475 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.349232 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(51a63a79b0ee42aba9fc7bf8e8c7428e): perf score=0.033346
I20240502 20:49:09.351109 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.016s user 0.015s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":155,"dirs.run_cpu_time_us":173,"dirs.run_wall_time_us":1264,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":503,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":234,"threads_started":2,"wal-append.queue_time_us":224}
I20240502 20:49:09.352061 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9): 4925 bytes on disk
I20240502 20:49:09.352461 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.353144 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(51586991cf25422681e1f758f6b7c52d): perf score=0.033348
I20240502 20:49:09.362948 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(51a63a79b0ee42aba9fc7bf8e8c7428e) complete. Timing: real 0.014s user 0.008s sys 0.004s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":170,"dirs.run_wall_time_us":1182,"drs_written":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4,"lbm_write_time_us":473,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":89,"threads_started":1,"wal-append.queue_time_us":150}
I20240502 20:49:09.364008 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(51a63a79b0ee42aba9fc7bf8e8c7428e): 4840 bytes on disk
I20240502 20:49:09.364357 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(51a63a79b0ee42aba9fc7bf8e8c7428e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":43,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.365325 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.012s user 0.010s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":181,"dirs.run_wall_time_us":1032,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":515,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":73,"threads_started":1,"wal-append.queue_time_us":175}
I20240502 20:49:09.366129 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d): 4586 bytes on disk
I20240502 20:49:09.366464 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.375975 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9): perf score=0.033360
I20240502 20:49:09.388463 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.012s user 0.012s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":165,"dirs.run_cpu_time_us":209,"dirs.run_wall_time_us":1589,"drs_written":1,"lbm_read_time_us":41,"lbm_reads_lt_1ms":4,"lbm_write_time_us":418,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":152,"threads_started":2,"wal-append.queue_time_us":129}
I20240502 20:49:09.389276 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9): 4925 bytes on disk
I20240502 20:49:09.389691 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.390375 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(51586991cf25422681e1f758f6b7c52d): perf score=0.033359
I20240502 20:49:09.402194 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: FlushMRSOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":40,"dirs.run_cpu_time_us":166,"dirs.run_wall_time_us":1341,"drs_written":1,"lbm_read_time_us":34,"lbm_reads_lt_1ms":4,"lbm_write_time_us":384,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":83,"threads_started":1,"wal-append.queue_time_us":150}
I20240502 20:49:09.403048 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d): 4586 bytes on disk
I20240502 20:49:09.403414 26034 maintenance_manager.cc:643] P 73a41df730ef429d84fe648df03a2701: UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.461668 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9): perf score=0.033376
I20240502 20:49:09.476732 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.015s user 0.013s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":261,"dirs.run_cpu_time_us":184,"dirs.run_wall_time_us":1432,"drs_written":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4,"lbm_write_time_us":520,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":120,"threads_started":2,"wal-append.queue_time_us":119}
I20240502 20:49:09.477684 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling FlushMRSOp(51586991cf25422681e1f758f6b7c52d): perf score=0.033378
I20240502 20:49:09.490760 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9): perf score=0.033393
I20240502 20:49:09.491703 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: FlushMRSOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.014s user 0.012s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":56,"dirs.run_cpu_time_us":227,"dirs.run_wall_time_us":1388,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":450,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":59,"threads_started":1,"wal-append.queue_time_us":172}
I20240502 20:49:09.492883 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9): 4925 bytes on disk
I20240502 20:49:09.493324 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.494167 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d): 4586 bytes on disk
I20240502 20:49:09.494568 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":70,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.495350 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling FlushMRSOp(51a63a79b0ee42aba9fc7bf8e8c7428e): perf score=0.033368
I20240502 20:49:09.505244 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.014s user 0.013s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":181,"dirs.run_cpu_time_us":155,"dirs.run_wall_time_us":1867,"drs_written":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4,"lbm_write_time_us":512,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":157,"threads_started":2,"wal-append.queue_time_us":136}
I20240502 20:49:09.506259 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(51a63a79b0ee42aba9fc7bf8e8c7428e): perf score=0.033395
I20240502 20:49:09.508016 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: FlushMRSOp(51a63a79b0ee42aba9fc7bf8e8c7428e) complete. Timing: real 0.013s user 0.012s sys 0.001s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":185,"dirs.run_wall_time_us":1183,"drs_written":1,"lbm_read_time_us":33,"lbm_reads_lt_1ms":4,"lbm_write_time_us":426,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":60,"threads_started":1,"wal-append.queue_time_us":126}
I20240502 20:49:09.509311 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling UndoDeltaBlockGCOp(51a63a79b0ee42aba9fc7bf8e8c7428e): 4840 bytes on disk
I20240502 20:49:09.509698 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: UndoDeltaBlockGCOp(51a63a79b0ee42aba9fc7bf8e8c7428e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.518776 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(51a63a79b0ee42aba9fc7bf8e8c7428e) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":48,"dirs.run_cpu_time_us":175,"dirs.run_wall_time_us":1102,"drs_written":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4,"lbm_write_time_us":378,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":79,"threads_started":1,"wal-append.queue_time_us":151}
I20240502 20:49:09.519704 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9): 4925 bytes on disk
I20240502 20:49:09.520059 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(50134092a82f42b08ffacf2eff58b0f9) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.520761 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(51586991cf25422681e1f758f6b7c52d): perf score=0.033396
I20240502 20:49:09.529471 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(51586991cf25422681e1f758f6b7c52d): perf score=0.033391
I20240502 20:49:09.537256 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.016s user 0.012s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":49,"dirs.run_cpu_time_us":172,"dirs.run_wall_time_us":1134,"drs_written":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4,"lbm_write_time_us":516,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":92,"threads_started":1,"wal-append.queue_time_us":176}
I20240502 20:49:09.538146 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(51a63a79b0ee42aba9fc7bf8e8c7428e): 4840 bytes on disk
I20240502 20:49:09.538584 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(51a63a79b0ee42aba9fc7bf8e8c7428e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.538873 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(51a63a79b0ee42aba9fc7bf8e8c7428e): perf score=0.033397
I20240502 20:49:09.539543 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d): 4586 bytes on disk
I20240502 20:49:09.539932 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.543612 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.014s user 0.009s sys 0.004s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":194,"dirs.run_cpu_time_us":207,"dirs.run_wall_time_us":1243,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":530,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":180,"threads_started":2,"wal-append.queue_time_us":150}
I20240502 20:49:09.544433 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d): 4586 bytes on disk
I20240502 20:49:09.544761 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(51586991cf25422681e1f758f6b7c52d) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4}
I20240502 20:49:09.550994 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(51a63a79b0ee42aba9fc7bf8e8c7428e) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":174,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":1092,"drs_written":1,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":423,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":131,"threads_started":2,"wal-append.queue_time_us":127}
I20240502 20:49:09.551956 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(51a63a79b0ee42aba9fc7bf8e8c7428e): 4840 bytes on disk
I20240502 20:49:09.552326 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(51a63a79b0ee42aba9fc7bf8e8c7428e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4}
W20240502 20:49:09.571753 26559 consensus_peers.cc:485] T f81a35dbe00342f89c4a42a3cfbbeacc P 4855f9c9a7f64986b4a0eb21e1ef6f0a -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
W20240502 20:49:09.687566 26163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20240502 20:49:09.694149 26427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 20 similar messages]
W20240502 20:49:09.694816 26427 consensus_peers.cc:485] T fe3671f95cd0488cbdf684011ad3d1e3 P 9aaa16c4fc46478f90a3d97b010330c2 -> Peer 21a5e6dc2695447798b4a87e7c6108db (127.9.82.138:38195): Couldn't send request to peer 21a5e6dc2695447798b4a87e7c6108db. Status: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111). This is attempt 211: this message will repeat every 5th retry.
I20240502 20:49:10.012117 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling FlushMRSOp(441da21c8ff8492c88c752ebf1233857): perf score=0.033366
I20240502 20:49:10.024191 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: FlushMRSOp(441da21c8ff8492c88c752ebf1233857) complete. Timing: real 0.012s user 0.010s sys 0.001s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":160,"dirs.run_cpu_time_us":235,"dirs.run_wall_time_us":1424,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":450,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":153,"threads_started":2,"wal-append.queue_time_us":130}
I20240502 20:49:10.025053 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling UndoDeltaBlockGCOp(441da21c8ff8492c88c752ebf1233857): 4840 bytes on disk
I20240502 20:49:10.025425 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: UndoDeltaBlockGCOp(441da21c8ff8492c88c752ebf1233857) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.026185 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling FlushMRSOp(d19c2fce372b4bbb936013051cc32978): perf score=0.033363
I20240502 20:49:10.037417 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: FlushMRSOp(d19c2fce372b4bbb936013051cc32978) complete. Timing: real 0.011s user 0.008s sys 0.001s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":50,"dirs.run_cpu_time_us":242,"dirs.run_wall_time_us":1502,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":391,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":80,"threads_started":1,"wal-append.queue_time_us":184}
I20240502 20:49:10.038200 26408 maintenance_manager.cc:419] P bbee1301f7b94c6ab339ecaccc4ce740: Scheduling UndoDeltaBlockGCOp(d19c2fce372b4bbb936013051cc32978): 4586 bytes on disk
I20240502 20:49:10.038566 26298 maintenance_manager.cc:643] P bbee1301f7b94c6ab339ecaccc4ce740: UndoDeltaBlockGCOp(d19c2fce372b4bbb936013051cc32978) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.042539 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(d19c2fce372b4bbb936013051cc32978): perf score=0.033376
I20240502 20:49:10.047124 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0): perf score=0.033371
I20240502 20:49:10.054682 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0): perf score=0.033378
I20240502 20:49:10.060017 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(d19c2fce372b4bbb936013051cc32978) complete. Timing: real 0.017s user 0.014s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":213,"dirs.run_cpu_time_us":159,"dirs.run_wall_time_us":2144,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":541,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"spinlock_wait_cycles":1792,"thread_start_us":202,"threads_started":2,"wal-append.queue_time_us":146}
I20240502 20:49:10.061218 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(d19c2fce372b4bbb936013051cc32978): 4586 bytes on disk
I20240502 20:49:10.061611 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(d19c2fce372b4bbb936013051cc32978) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.062508 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0): perf score=0.033370
I20240502 20:49:10.068992 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.022s user 0.017s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":636,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":160,"threads_started":2,"wal-append.queue_time_us":146}
I20240502 20:49:10.070540 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.016s user 0.010s sys 0.004s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":142,"dirs.run_cpu_time_us":205,"dirs.run_wall_time_us":1229,"drs_written":1,"lbm_read_time_us":37,"lbm_reads_lt_1ms":4,"lbm_write_time_us":609,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":134,"threads_started":2,"wal-append.queue_time_us":414}
I20240502 20:49:10.071560 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0): 4925 bytes on disk
I20240502 20:49:10.071936 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling FlushMRSOp(d19c2fce372b4bbb936013051cc32978): perf score=0.033375
I20240502 20:49:10.072028 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.072889 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(d19c2fce372b4bbb936013051cc32978): perf score=0.033366
I20240502 20:49:10.083760 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.021s user 0.016s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":1087,"drs_written":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4,"lbm_write_time_us":524,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":94,"threads_started":1,"wal-append.queue_time_us":634}
I20240502 20:49:10.084901 26012 maintenance_manager.cc:419] P 3c6dc91a7df244ab82c1161799ba2ff3: Scheduling UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0): 4925 bytes on disk
I20240502 20:49:10.085952 25902 maintenance_manager.cc:643] P 3c6dc91a7df244ab82c1161799ba2ff3: UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.091262 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: FlushMRSOp(d19c2fce372b4bbb936013051cc32978) complete. Timing: real 0.019s user 0.016s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":126,"dirs.run_wall_time_us":1645,"drs_written":1,"lbm_read_time_us":60,"lbm_reads_lt_1ms":4,"lbm_write_time_us":536,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":75,"threads_started":1,"wal-append.queue_time_us":143}
I20240502 20:49:10.092787 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0): 4925 bytes on disk
I20240502 20:49:10.093230 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.093864 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(d19c2fce372b4bbb936013051cc32978) complete. Timing: real 0.021s user 0.016s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":1143,"drs_written":1,"lbm_read_time_us":402,"lbm_reads_lt_1ms":4,"lbm_write_time_us":503,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":51,"threads_started":1,"wal-append.queue_time_us":348}
I20240502 20:49:10.094132 26672 maintenance_manager.cc:419] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: Scheduling UndoDeltaBlockGCOp(d19c2fce372b4bbb936013051cc32978): 4586 bytes on disk
I20240502 20:49:10.094560 26562 maintenance_manager.cc:643] P 4855f9c9a7f64986b4a0eb21e1ef6f0a: UndoDeltaBlockGCOp(d19c2fce372b4bbb936013051cc32978) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.095091 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(d19c2fce372b4bbb936013051cc32978): 4586 bytes on disk
I20240502 20:49:10.095746 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(d19c2fce372b4bbb936013051cc32978) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.096545 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling FlushMRSOp(441da21c8ff8492c88c752ebf1233857): perf score=0.033372
I20240502 20:49:10.108279 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: FlushMRSOp(441da21c8ff8492c88c752ebf1233857) complete. Timing: real 0.012s user 0.008s sys 0.003s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":50,"dirs.run_cpu_time_us":236,"dirs.run_wall_time_us":1263,"drs_written":1,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":415,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":93,"threads_started":1,"wal-append.queue_time_us":171}
I20240502 20:49:10.109138 26276 maintenance_manager.cc:419] P 6173ed1979b94e509bf1c843a5183690: Scheduling UndoDeltaBlockGCOp(441da21c8ff8492c88c752ebf1233857): 4840 bytes on disk
I20240502 20:49:10.109582 26166 maintenance_manager.cc:643] P 6173ed1979b94e509bf1c843a5183690: UndoDeltaBlockGCOp(441da21c8ff8492c88c752ebf1233857) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.117547 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(d19c2fce372b4bbb936013051cc32978): perf score=0.033397
I20240502 20:49:10.119220 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0): perf score=0.033393
W20240502 20:49:10.126991 26691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.82.138:38195: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20240502 20:49:10.133276 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.014s user 0.013s sys 0.000s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":159,"dirs.run_cpu_time_us":181,"dirs.run_wall_time_us":1333,"drs_written":1,"lbm_read_time_us":35,"lbm_reads_lt_1ms":4,"lbm_write_time_us":539,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":134,"threads_started":2,"wal-append.queue_time_us":125}
I20240502 20:49:10.134176 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling FlushMRSOp(441da21c8ff8492c88c752ebf1233857): perf score=0.033390
I20240502 20:49:10.135569 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(d19c2fce372b4bbb936013051cc32978) complete. Timing: real 0.018s user 0.014s sys 0.000s Metrics: {"bytes_written":6062,"cfile_init":1,"dirs.queue_time_us":141,"dirs.run_cpu_time_us":137,"dirs.run_wall_time_us":875,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":544,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":635,"thread_start_us":122,"threads_started":2,"wal-append.queue_time_us":321}
I20240502 20:49:10.136758 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0): perf score=0.033402
I20240502 20:49:10.147778 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: FlushMRSOp(441da21c8ff8492c88c752ebf1233857) complete. Timing: real 0.013s user 0.009s sys 0.004s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":135,"dirs.run_wall_time_us":1981,"drs_written":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4,"lbm_write_time_us":546,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":76,"threads_started":1,"wal-append.queue_time_us":149}
I20240502 20:49:10.148658 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0): 4925 bytes on disk
I20240502 20:49:10.149103 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.149879 26540 maintenance_manager.cc:419] P 9aaa16c4fc46478f90a3d97b010330c2: Scheduling UndoDeltaBlockGCOp(441da21c8ff8492c88c752ebf1233857): 4840 bytes on disk
I20240502 20:49:10.150158 26430 maintenance_manager.cc:643] P 9aaa16c4fc46478f90a3d97b010330c2: UndoDeltaBlockGCOp(441da21c8ff8492c88c752ebf1233857) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":44,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.152745 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.016s user 0.010s sys 0.004s Metrics: {"bytes_written":6144,"cfile_init":1,"dirs.queue_time_us":52,"dirs.run_cpu_time_us":145,"dirs.run_wall_time_us":963,"drs_written":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4,"lbm_write_time_us":425,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":689,"thread_start_us":73,"threads_started":1,"wal-append.queue_time_us":146}
I20240502 20:49:10.153774 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0): 4925 bytes on disk
I20240502 20:49:10.154156 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: UndoDeltaBlockGCOp(00bf11a3e1c24449bba6a09d4ab280b0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4}
I20240502 20:49:10.154893 26804 maintenance_manager.cc:419] P b4908484400a4ce2aea341e9e1bdced3: Scheduling FlushMRSOp(441da21c8ff8492c88c752ebf1233857): perf score=0.033400
I20240502 20:49:10.156653 26144 maintenance_manager.cc:419] P 73a41df730ef429d84fe648df03a2701: Scheduling FlushMRSOp(d19c2fce372b4bbb936013051cc32978): perf score=0.033401
I20240502 20:49:10.173738 26694 maintenance_manager.cc:643] P b4908484400a4ce2aea341e9e1bdced3: FlushMRSOp(441da21c8ff8492c88c752ebf1233857) complete. Timing: real 0.019s user 0.015s sys 0.000s Metrics: {"bytes_written":6152,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":192,"dirs.run_wall_time_us":1313,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":540,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":676,"thread_start_us":105,"threads_started":1,"wal-append.queue_time_us"